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ABSTRACT 


In  many  applications  of  recursive  estimation  theory  to  trajectory 
estimation  the  process  dynamics  are  not  used.  In  these  cases  one  norm- 
ally resorts  to  approximating  the  forces  with  fitting  functions.  Poly- 
nomials, exponentially  weighted  polynomials  and  trigonometric  and  their 
orthogonal  counterparts  Gram,  Legendre,  and  Laguarre  polynomials  are 
developed  in  a vector  space  setting. 

Matrices  describing  the  connections  between  the  bases  and  their  ve- 
locity matrices  and  their  pseudo- inverses  are  developed.  Continuous  and 
discrete  function  filtering  dynamics  are  presented.  These  relations  can 
serve  as  an  aid  to  fitting  functions  filter  design. 
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the  forces  with  fitting  functions.  Polynomials,  exponentially  weighted  polynomials 
and  trigonometric  and  their  orthogonal  ccunterparts  Gram,  Legendre,  and  Laguhrre 
polynomials  are  developed  in  a vector  space  setting. 

Matrices  describing  the  connections  between  the  bases  and  their  velocity  matrices 
and  their  pseudo- inverses  are  developed.  Continuous  and  discrete  function  filtering 
dynamics  are  presented.  These  reLations  can  serve  as  an  aid  to  fitting  functions 
filter  design. 

\ 

\ 


% 


uj 


TABLE  OF  CONTENTS  - VOLUME  I 

Introduction  vil 

SECTION  1 SOME  VECTOR  SPACE  METHODS  FOR  CONTINUOUS  FUNCTION  THEORY  . . 1 

General  Relations  1 

Orthogonal  Polynomials,  Vectors,  and  Matrices,  Via  Gram-Schmldt  and 
Triangular  Decompositions  31 

Continuous  Gram-Schmidt  Polynomials  (0,1)  62 

Triangular  Factors  of  the  Inverse  of  a Positive  Definite  (Full  Rank) 

Real  Matrix 66 

The  Inverse  of  the  Triangular  Factor  Matrix  68 

Continuous  Modified  Legendre  Polynomials  (-1,1)  70 

Gram-Schmidt  Procedures  In  Different  Bases  76 

Weighted  Gram-Schmidt 79 

Modified  Gram-Schmidt  80 

Triangular  Decompositions  and  Matrix  Inversion  Via  Cholesky  Procedure  . 84 

Gram-Schmidt  of  the  Discrete  Metric  Matrix  for  the  Fitting  Functions  of 
a Discrete  Span  of  Points 89 

Alternative  Orthogonal  Process  to  the  Gram-Schmidt  95 

Alternative  Gram-Schmidt  First  Coordinate  Unity  97 

SECTION  2 GENERALIZATIONS  OF  SOME  CONTINUOUS  METRICS  AND  ORTHOGONAL 
POLYNOMIALS  WITH  RESPECT  TO  PARTICULAR  WEIGHTS  107 

Continuous  Laguerre  Polynomials  Ill 

Continuous  Poisson  Polynomials  139 

Continuous  Exponential  Polynomials  143 

Continuous  Gram  Polynomials  146 

Continuous  Legendre  Polynomials  156 

SECTION  3 TRANSLATION  OF  ORIGIN  AND  SEALING  ON  THE  TIME  AXIS  AND  IN- 
DUCED TRANSFORMATION  METRIC  MATRICES  AND  GRAM-SCHMIDT  VECTOR  RE- 
SCALING   168 


1 


I 


A.  Monomial  Base  Metric  for  Arbitrary  Intervals  168 

Case  I.  Transformation  Metric  (0,1)  (O.t^)  168 

Case  II.  Transformation  Metric  (“t2,t2)  170 

Case  III.  Transformation  Metric  C0,1)  

Case  IV.  Transformation  Metric  (-1,1)  (-t_,t  ,t„)  179 

L c.  I 

Case  V.  Transformation  Metric  Due  to  Sign  Change 184 

Case  VI.  Transformation  to  New  Origin  with  Sign  Reversal 186 

Case  VII.  Transformation  Metric  (0,1)  (-1,1)  190 

B.  Transformations  on  Gram-Schmidt  Vectors  from  Classical  Intervals 

to  Arbitrary  Intervals  192 

C.  Exponential  Base  Metrics 194 

D.  Transformation  of  Gram-Schmidt  Vector  from  (0,")  (0,-")  197 

SECTION  4 POLYNOMIAL  VECTORS,  BASES,  BASE  CHANGES,  POLYNOMIAL  DERIVA- 
TIVES, BASE  DERIVATIVES  AND  BASE  INTEGRALS 200 

Time  Derivatives  of  Time-Varying  Bases . 219 

Multiple  Integration  of  Bases  and  Base  Dyadic  Product  Integration  . . 221 

Inner  Products,  Base  Metrics,  Hankel  and  Hilbert  Matrices  224 

Toeplltz  State  Transition  Matrices  in  Continuous  Polynomials  237 

Toeplitz  State  Transition  Matrix  in  Taylor  Series  Approximation  . . . 245 

State  Dynamics  for  Continuous  Polynomials  and  Polynomial  Base  Change  . 248 

State  Dynamic  Equation  Changes  Due  to  Time-Axis  Base  Change  257 

SECTION  5 DISCRETE  "METRIC  MATRIX"  FOR  FRONT,  BACK  AND  CENTER  OF  SPAN  264 

Monomial  Base  Metrics 264 

Discrete  Metric  Matrix  for  Forward  and  Backward  Exponentially  Weighted 
Monomial  Base 296 

Orthogonal  Polynomials  Over  Discrete  Point  Sets  Front,  Central  and 

Back;  Gram,  Legendre  and  Laguarre  304 


11 


] 


L 


SECTION  6 SOME  GENERALIZATIONS  OF  THE  DISCRETE  DIFFERENCES  OF 
POLYNOMIALS  AND  THE  BASE  FITTING  FUNCTIONS  


Generalities 


Minimal  Set  of  First  Differences 


All  Combinations  of  First  Differences 


Weighted  Difference-Matrices 


K Forward  Difference  from  Back  of  Span  to  Front 


Discrete  Differences  of  the  Fitting  Functions 


K Backward  Differences  from  Front  of  Span  to  Back 


Discrete  Differencing  of  Newton  Polynomials 


SECTION  7 DIVIDED  DIFFERENCES  AND  INTERPOLATING  POLYNOMIALS  . 


LaGrange  Interpolating  Polynomials 


Newton  Form  of  Interpolating  Polynomials  and  Generalized  Weighted 
Differences  


VOLUME  II 

SECTION  8 GENERALIZATIONS  ON  DERIVATIVES  OF  BASE  FITTING  FUNCTIONS 
AND  TRANSITION  MATRICES  


Derivatives  of  Monomial  Base 


Velocities  for  Gram  Orthogonal  Polynomial  Base 


Time  Derivatives  of  Legendre  Polynomials  . 


Time  Derivatives  of  Exponentially  Weighted  Base  and  Laguarre  Poly- 
nomials   


SECTION  9 FITTING  FUNCTION  STATE  EQUATIONS 


SECTION  10  GENERAL  RELATIONS  FOR  PARAMETER  ESTIMATION 


SECTION  11  UNCONSTRAINED  UNWEIGHTED  PARAMETER  ESTIMATION 


Case  1.  Back  to  Front  (Forward)  Polynomials 


Case  2.  Mid-Point  Polynomials 


'll 


Case  3.  Front  to  Back  Polynomials 452 

Case  4.  Discrete  Orthogonal  Polynomials  Back  to  Front  453 

Case  5.  Mid-Point  Discrete  Orthogonal  Polynomials  (Ortho-normal).  . . 457 

Case  6.  Front  to  Back  or  Backward  Orthogonal  Polynomials 461 

Case  7.  Backward  Exponential  Weighted  Polynomials  461 

SECTION  12  UNCONSTRAINED  UNWEIGHTED  STATE  ESTIMATION  465 

SECTION  13  RECURSIVE  PSUEDO  INVERSES  AND  PROJECTORS  472 

SECTION  14  RECURSIVE  UNCONSTRAINED  UNWEIGHTED  PARAMETER  ESTIMATION  . 494 

SECTION  15  RECURSIVE  UNCONSTRAINED  UNWEIGHTED  STATE  ESTIMATION  ...  498 

SECTION  16  UNWEIGHTED  RECURSIVE  ESTIMATION  OVER  FIXED  SPAN  502 

SECTION  17  CONSTRAINED  LEAST-SQUARES  RECURSIVE  ESTIMATION  FOR  ONE 

DEGREE  OF  FREEDOM 509 

SECTION  18  OPTIMAL  WEIGHTING  MATRIX  FOR  PARAMETER  ESTIMATION  ....  516 

SEC^  9 RECURSIVE  WEIGHTED  UNCONSTRAINED  PARAMETER  ESTIMATION 

(T  NG  SPAN)  526 

ZU  HOMOGENEOUS  DISCRETE  DYNAMIC  PROCESS  529 

SECTION  21  NON-HOMOGENEOUS  DISCRETE  DYNAMICAL  PROCESS  536 

SECTION  22  STOCHASTIC  DISCRETE  DYNAMICAL  SYSTEM  542 

SECTION  23  ADDITIVE  NOISY  MEASUREMENTS  OF  THE  DISCRETE  DYNAMICAL 

PROCESS 548 

SECTION  24  DISCRETE  KALMAN  FILTER  DERIVATION  551 

SECTION  25  WALSH  FUNCTIONS  578 

SECTION  26  HOMOGENEOUS  DYNAMICAL  SYSTEM  599 

SECTION  27  PARTITIONED  HOMOGENEOUS  DYNAMICAL  SYSTEMS  RICCATTI  DIF- 
FERENTIAL EQUATION  AND  ADJOINT  SYSTEMS  629 

Block  Orthogonal  Subsystems  of  ^ 640 

Dynamics  of  Singleton  Pseudo- Inverses  645 

Dynamics  of  X*  Complete  Pseudo-Inverse  for  Non-Full  Rank  Case  ....  648 


Rectangular  Matrix  Rlccatti  654 

SECTION  28  HOMOGENEOUS  SYSTEM  DIAGONALIZATION  OR  DECOUPLING  OF 
TRIANGULAR  SYSTEMS  659 

Solution  to  the  Upper  Triangular  Dynamical  System  via  the  Diagonal 

System  and  a Matrix  Rlccatti  Dynamical  System 669 

The  Diagonalizing  Transformation  via  Kronecker  Matrix  Product  Solu- 
tions   675 

SECTION  29  TRIANGULARIZATION  AND  DIAGONALIZATION  OR  DECOUPLING  OF 
ARBITRARY  NON-HOMOGENEOUS  DYNAMICAL  SYSTEM  677 

SECTION  30  TRANSFORMATION  OF  HOMOGENEOUS  DYNAMICAL  SYSTEM  TO  BLOCK 
COMPANION  MATRIX  FORM 681 

SECTION  31  NON-HOMOGENEOUS  DYNAMICAL  SYSTEM  X = A X + F(t)  684 

SECTION  32  VARIANCES  RELATED  TO  x>  = Ax>.  + U> 686 

j J J 

SECTION  33  DIFFERENCES  OF  MATRIX  RLCCATTI  SOLUTIONS  689 

SECTION  34  SOLUTIONS  OF  MATRIX  RICCATTI  VIA  DIAGONALIZATION  TECH- 
NIQUES   692 

SECTION  35  SOLUTION  OF  MATRIX  T = + ^21^ 

SECTION  36  SOLUTION  OF  T = -TA^^  + A22T  -^^^21 

SECTION  37  SOLUTION  T = -TAj^2^ ^01 

SECTION  38  SOLUTION  T = -TAj^2''‘’  ■*"  ^21 

SECTION  39  SOLUTION  OF  T = -TA^^  + A22T  - TA^2T 705 

SECTION  40  SOLUTION  T = -TA^^j^  + A22T  - TAj^2'^  ^21 

SECTION  41  THE  CONTINUOUS  KALMAN  FILTER  708 

SECTION  42  CHANDRASEKHAR  TYPE  ALGORITHMS  FOR  SOLUTION  OF  OPTIMAL 

KALMAN  GAIN  MATRIX 719 


APPENDICES 

A.  The  Binomial  Matrices,  Rutishauser  Matrices  and  Their  Inverses  . . . 724 

B.  Backward  and  Forward  Factorial  Function  Matrices,  Sterling  and 

Relations  to  Rutishauser  and  Binomial  Matrices  754 

C.  Formulas  for  the  Sum  of  the  d^^  Powers  of  the  First  N Integers  . . . 765 

D.  Integration  By  Parts  of  /t'^e^^'dt 769 

E.  Base  and  Metric  Relations 772 

F.  Gradients  of  Traces  of  Matrix  Functions  775 

G.  Kronecker  Matrix  Products  794 

H.  Dirac  Delta  Function  815 


INTRODUCTION 


State  Space  Techniques  For  Approximation  Theory  With  Applications  To  Optimal 
Estimation. 

The  applications  of  modern  optimal  estimation  theory  (Kalman  Theory)  to 
flight  test  trajectory  estimation  has  brought  about  a need  by  those  develop- 
ing computer  programs  (the  mathware)  to  obtain  a broader  systems  analysis 
viewpoint  of  the  total  test  procedure.  All  through  the  1960 's  most  of  the 
personnel  responsible  for  flight  test  data  reduction  -it  the  national  missile 
ranges  were  primarily  mathematicians  and  statisticians.  The  advent  and 
global  acceptance  of  the  Kalman  Estimation  Theory  necessitated  that  data 
reducers  also  apply  the  tools  of  flight  simulation  groups,  namely  missile 
stochastic  dynamical  models  augumented  with  instrumentation-system  dynamics. 
In  actual  practice  today  most  applications  of  the  theory  are  sjboptimal  mod- 
ifications since  most  missile  flight  processes  are  highly  non-linear  (math- 
ematical descriptions  highly  dependent  on  wind  tunnel  data)  with  only  par- 
tially known  statistics  of  the  process  uncertainties  and  very  poorly  known 
non-linear  measurement  instrument  dynamics  and  measurement  instrument  vari- 
ances and  biases. 

The  next  best  thing  to  a complete  simulation  missile  model  is  to  use 
approximation  theory  conditioned  and  constrained  by  a good  hueristic  engi- 
neering feel  about  the  total  process . The  earlier  applications  by  the 
ranges  have  been  in  power-series  polynomials  and  orthogonal  polynomials  with 
a vast  amount  of  literature  available  in  this  area  of  moving  arc  smoothing 
etc.  Unfortunately  most  of  the  literature  on  approximation  theory  as  well 
as  published  reports  is  steeped  in  the  classical  tedium  of  multiple  nested- 
summations  and  countless  indices  running  and  stopping.  The  Kalman  Theory 
based  on  the  differential  equations  of  the  process  is  beautifully  done  in 
state-space  mathematics. 

The  vast  acceptance  among  engineering  circles  of  the  Kalman  approach 
has  brought  about  complete  new  curriculums  in  engineering  training  with  big 
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demands  for  vector  space  theory  matrices  and  modem  algebraic  concepts  to 
better  understand  the  mode  < approach  to  algebraic  system  theory.  The  math 
departments  should  be  forever  endeared  to  Kalman. 

The  math  modeling  techniques  for  flight  dynamics  of  aerospace  vehicles 
for  many  interacting  moving  reference  frames  on  which  sensors  are  mounted 
can  best  be  handled  with  the  vectors  and  dyadics  used  by  Gibbs  but  cast  into 
a matrix  setting  as  described  in  reference  (69). 

Thus  modern  estimation  theory  requires  math  models  unified  from  the 
following  disciplines: 


Flight  Mechanics 
Instrument  Dynamics 
Statistics 
Numerical  Analysis 
Matrix  Numerical  Methods 
Approximation  Theory 

The  primary  concern  of  this  report  is  to  develop  vector  space  and 
matrix  relations  useful  in  the  design  of  recursive  optimal  estimations  based 
on  assumed  fitting- function  (approximation)  models  when  the  process  dynamic 
model  is  not  known. 

This  task  necessitated  a sizeable  attempt  to  survey  some  of  the  vast 
amount  of  published  literature  on  approximation  theory  in  books  and  journals 
and  establish  some  connections  useful  to  the  modern  vogue  of  state-space 
(vector  and  matrix  dynamic  representations). 

Householder  in  ref  ( 39)  says  that  orthogonal  polynomials  themselves 
have  an  extensive  li-t-erature  which  he  will  not  bother  to  cite,  but  that 
their  association  with  matrices  seems  to  be  relatively  new. 

Davis  says  that  the  fields  of  interpolation  and  approximation  have  been 
cultivated  for  centuries.  The  amount  of  information  available  is  truly 
staggering  so  he  presents  in  his  book  the  topics  that  caught  his  imagination. 

He  says  that  Bernstein  polynomials  yield  smooth  approximants  and  provide 
simultaneous  approximation  of  the  function  and  its  derivatives;  the  mimic  the 
behavior  of  the  function  to  a remarkable  degree  nut  the  price  paid  for  their 
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beautiful  approximation  properties  is  very  slow  convergence. 

Davis  published  his  book  in  1963  and  says  that  during  the  past  few 
decades,  the  subject  of  interpolation  and  approximation  has  not  been  overly 
popular  in  American  universities.  Since  the  development  of  high  speed  com- 
puting machinery,  the  flame  of  interest  in  interpolation  and  approximation 
has  burned  brighter;  and  the  realization  that  portions  of  the  theory  are  best 
presented  through  functional  analysis  has  added  fuel  to  the  flame. 

Rice  [The  Approximation  of  Fiinctions,  1964]  says  the  main  problem  con- 
sidered in  his  book  is  the  approximation  of  a real  continuous  function  x(t) 
by  an  approximating  function,  and  that  there  are  two  major  items  in  this 
problem  to  be  stated.  The  first  of  these  is  the  type  of  approximating 
function  used,  and  the  second  is  how  one  measures  the  "goodness"  of  an 
approximation.  He  says  there  is  no  scientific  method  of  determining  which  of 
the  many  approximating  functions  normally  available  will  lead  to  the  most 
efficient  approximation  of  x(t).  The  choice  of  approximation  function  has  to 
be  made  on  the  basis  of  experience  and  intuition.  The  first  three  states 
(the  function  and  the  first  and  second  derivative  of  the  function)  are  needed 
in  trajectory  estimation.  Rice  says  that  the  second  major  item  to  be  speci- 
fied is  the  measure  of  the  goodness  of  the  approximation  to  be  used  but  is  of 
less  importance  than  the  choice  of  the  approximating  function.  The  "measures 
of  approximation"  or  "distance  functions"  are  used  to  determine  the  distance 
of  an  approximation  from  x(t).  Rice  says  that  given  a function  x(t)  to 
approximate,  there  is  a rather  fixed  sequence  of  steps  to  be  made,  the  first 
of  which  is  to  translate  the  intuitive  or  practical  problem  into  a mathemat- 
ically precise  form.  This  means  that  one  must  choose  the  approximating 
function  and  the  distance  function.  If  the  approximation  problem  is  already 
presented  in  a mathematically  precise  form  (as  is  often  the  case)  then  this 
step  is  missing.  However,  if  such  choices  are  to  be  made,  it  should  be  rec- 
ognized that  these  choices  are  the  most  important  of  all  the  steps  toward  ob- 
>■3  ■ ling  an  approximation.  Poor  choices  at  this  point  can  make  severe  diffi- 
culties unavoidable,  no  matter  how  talented  one  may  be  at  mathematical 
analysis.  He  says  that  once  the  problem  is  given  in  a mathematically  precise 
form  there  are  a number  of  phases  in  its  solution: 
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1.  Choice  of  approximating  function  and  distance  function. 

2.  The  existence  of  a solution. 

3.  The  uniqueness  of  a solution. 

4.  The  characteristic  and  other  special  properties  of  the  solution. 

5.  The  computation  of  the  solution. 

With  respect  to  item  1 above.  Rice  says  that  there  are  some  general 
guide-lines  available.  He  says  that  in  actual  practice  (as  opposed  to 
theoretical  analysis)  there  is  only  ^ very  small  set  of^  functions  available 
to  be  used  as  approximating  functions . This  set  includes  polynomials , 
rational  functions  (the  ratio  of  two  polynomials),  and  trigonometric  sums. 

In  special  situations,  one  may  have  analytical  reasons  for  using  special 
functions  such  as  the  logarithm  function,  the  exponential  function,  Bessel 
functions,  piecewise  polynomials,  etc.  Even  with  the  addition  of  these 
special  functions,  the  total  set  of  approximating  functions  is  small.  On 
the  other  hand,  the  particular  choice  from  this  small  set  may  not  be  clear 
in  many  instances. 

Rice  says  the  key  to  efficient  approximation  is  to  find  an  approximating 
function  which  can  take  on  the  same  nature  of  behavior  as  x(t).  The 
approximating  functions  with  limited  range  of  behavior  are,  naturally,  the 
most  common  and  the  simplest  to  use.  These  are  the  polynomials  and  trig- 
onometric sums.  A word  which  describes  this  behavior  well  is  "roly-poly". 

These  functions  are  unable  to  take  on  sharp  bends  followed  by  relatively  flat 
behavior.  Likewise,  these  approximating  functions  are  unable  to  manage  very 
large  or  infinite  slopes  followed  by  "normal"  behavior.  For  functions  of  a 
roly-poly  (or  gently  varying)  nature,  however,  these  approximating  functions 
are  very  efficient. 

Rice  states  further  that  one  common  method  of  circumventing  the  roly-poly 
nature  of  polynomials  is  to  increase  the  degree.  As  the  degree  of  a polynomial 
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or  trigonometric  sum  increases,  the  polynomial  is  more  and  more  able  to 
follow  a function  that  is  not  of  a roly-poly  natxire.  This  method  has  the 
obvious  drawback  of  requiring  a complicated  approximating  function  and, 
frequently,  of  being  difficult  to  evaluate,  i.e.,  being  numerically  unstable. 

Rice  says  a class  of  approximating  functions  which  has  a much  greater 
degree  of  flexibility  is  the  class  of  rational  functions: 


E a.t^ 

x(t)  = 

I b.t^ 

i=0  ^ 

A rational  function  of  relatively  low  degree  can  take  on  a form  which  cannot 
be  effectively  approximated  by  polynomials  of  low  or  medium  degree.  These 
approximating  functions  have  the  additional  advantage  that  they  are  simple 
to  use.  Their  principal  disadvantage  is  that  it  is  considerbly  more 
difficult  to  compute  approximations  by  rational  functions  than  by  poly- 
nomials. However,  new  techniques  and  widespread  availability  of  high-speed 
computing  machines  are  rapidly  reducing  the  importance  of  this  disadvantage. 

Rice  states  that  another  class  of  approximating  functions  which  deserves 
coi  deration  is  the  class  of  piecewise  pol5momial  functions.  These  functions 
ar  fined  by  dividing  the  interval  [0,1]  into  several  intervals  by  a set  of 
p called  joints.  The  approximating  function  is  then  a polynomial  of 

sp  ied  degree  between  the  joints.  The  approximating  function  is  either 
lii.  ar  (in  case  the  joints  are  given)  or  nonlinear  (in  case  the  joints  are 
to  be  determined). 

Rice  claims  that  a particularly  important  subclass  of  these  functions 
is  the  class  of  spline  functions,  which  are  piecewise  polynomial  functions 
of  n^^  degree  joined  smoothly  so  that  they  have  n-1  continuous  derivatives; 
i.e.,  there  is  a discontinuity  possible  only  in  the  n^^  derivative  at  the 
joints.  When  the  joints  are  given,  these  approximating  functions  have  three 
very  desirable  properties,  namely,  they  are  flexible,  they  are  linear  in  the 


parameters  (i.e.,  approximations  are  relatively  easy  to  compute),  and  they 
are  convenient  to  use  in  many  applications.  The  problems  associated  with 
the  "best  joints"  have  not  been  investigated  to  any  extent. 

Rice  says  that  it  appears  at  this  point  that  almost  every  aspect  of  the 
least-squares  approximation  problem  has  been  resolved,  and  in  theory  this  is 
true.  In  computation,  however,  there  is  still  a possible  difficulty  which 
is  touched  upon  here.  This  difficulty  arises  mainly  from  the  fact  that  the 
coefficient  matrix  of  the  normal  equations  may  be  ill-conditioned.  Space 
does  not  allow  a full  exposition  of  this  property,  but  it  suffices  to  say 
that  matrices  which  are  ill-conditioned  are  very  difficult  to  invert.  When 
one  is  doing  hand  computations  involving  four  or  five  parameters,  this  ill- 
conditioning  has  little  effect.  The  effect  became  of  increased  importance 
with  the  advent  of  high-speed  computers,  for  it  is  now  possible  to  make 
calculations  involving  a much  larger  number  of  parameters. 

To  illustrate  this.  Rice  says  we  shall  consider  the  most  common  example: 
namely,  when  f^(t)=t^  In  this  case,  the  coefficients  of  the  metric  matrix 
are 


1 

/ t 
0 


i-1 


-j-1 


dt 


1 

i+j-1 


the  coefficient  matrix  then  is  the  Hilbert  matrix: 


j 


Rice  says  the  inversion  of  a system  of  equations  with  this  coefficient  matrix 
is  notoriously  difficult.  If  there  are  ten  parameters,  then  the  inverse  of 


r ! 


this  matrix  has  elements  of  the  order  of  3x10 
-10 


12 


This  means  that  an  error 
of  lo  in  the  original  system  appears  as  an  error  of  the  order  of  300  in 
the  solution  for  the  parameters  of  the  best  Lj-approximation.  These  diff- 
iculties may  be  avoided  if  one  is  able  to  use  fj^(t)  approximately  orthogonal. 
There  are  many  systems  of  polynomials  available,  for  example,  for  use  on  an 
interval  or  on  finite  point  sets  of  approximately  uniform  distribution. 


Morrison  in  "Introduction  to  Sequential  Smoothing  and  Prediction"  (1969) 
uses  the  discrete  Lengendre  and  Laguerre  polynomials.  The  Legendre  polynomials 
form  the  basis  (instead  of  the  monomial  basis)  for  the  fixed  memory  polynomial 
filters  and  expanding  memory  polynomial  filters.  Morrison  uses  the  discrete 
Laguarre  polynomials  to  form  the  basis  for  the  Fading  Memory  Polynomial  Filters. 


Morrison  points  out  that  Hildebrand  considers  briefly  the  question  of 
orthogonality  over  a discretized  interval  and  derives  the  Gram  polynomials, 
sometimes  also  called  the  Chebyshev  polynomials.  These  polynomials  are  re- 
lated to  Morrisons  Legendre  polynomials  by  a shift  of  origin.  Morrison  says 
that  he  has  extended  Hildebrand's  approach  to  obtain  the  discrete  Legendre 
and  Laguerre  polynomials;  and  that  Milne  has  an  alternate  and  extremely  ele- 
gant derivation  of  the  discrete  Legendre  polynomials  in  his  book  "Numerical 
Calculus".  Morrison  says  that  recursive  parameter  estimation  over  fixed 
data  spans  using  the  classical  monomial  base  (power  of  t)  yields  matrices 
which  are  difficult  to  obtain  the  functional  form  of  the  inverse  of  anything 
much  beyond  a 2x2  is  obviously  out  of  the  question;  that  although  numerical 
inverses  would  give  correct  answers  resorting  to  numbers  would,  (at  the  stage 
of  discussion  in  his  book)  force  the  analysis  to  terminate,  and  the  analysis 
has  as  yet  hardly  begun.  [Many  of  the  ranges  do  use  second,  third,  and  fourth 
degree  polynomials  for  trajectory  estimation  and  these  inverses  are  included 
in  this  report.]  Morrison  states  on  page  238  that  the  discrete  Legendre  poly- 
nomials do  not  easily  permit  of  differentiation;  that  any  attempt  to  differen- 
tiate them  completely  fractures  their  structure,  and  all  order  is  therefore 
irretrievably  lost.  He  presents  two  solutions  to  this  problem. 

Lawson  ("Survey  of  Computer  Methods  for  Fitting  Curves  to  Discrete  Data 
or  Approximating  Continuous  Functions",  1968)  concentrates  his  discussion 
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primarily  upon  the  class  of  computational  problems  most  commonly  associated  j 

with  the  name  "approximation  theory",  namely  the  approximation  of  contin- 
uous functions  and  curve  fitting  to  discrete  data.  He  views  the  problems 
from  the  point  of  view  of  practical  scientific  computation.  Lawson  con- 
siders the  features  and  drawbacks  of  various  forms  of  the  approximating 
functions.  He  says  that  polynomials  are  in  some  sense  the  simplest  forms 
and  that  there  are  a variety  of  parameterizations  possible  for  a polynomial. 

When  expressed  as  ^^t^  which  he  calls  the  monomial  basis  parameterization. 

The  matrix  of  basic  function  values  is  typically  very  poorly  conditioned 
which  can  be  sianif ’ ’ tly  improved  by  translating  the  domain  of  the  inde- 
pendent variable  i at  zero.  Exponent  overflow  is  avoided  by 

scaling  to  [-l,ij.  .at  even  with  these  precautions  polynomials  of 

degree  higher  than  n in  monomial  basis  form  are  essentially  useless 

in  eight  decimal  aigit  a.'’ithmetic.  Other  bases  such  as  Chebyshev  polynomials 
typically  provide  remarkcible  stability.  A polynomial  of  degree  n represented 
as  a linear  combination  of  Chebyshev  polynomials  can  be  evaluated  in  n multi- 
plications and  2n  additions,  and  he  recommends  the  use  of  the  Chebyshev  basis  i 
in  preference  to  the  monomial  basis  wherever  polynomials  are  used  in  computa- 
tion unless  there  is  some  specific  reason  to  use  the  monomial  basis. 

Lawson  says  that  rational  forms  have  various  special  properties  such  as 
remaining  bounded  at  infinity,  having  poles,  and  having  abrupt  changes  of 
curvature,  which  sometimes  make  them  more  useful  than  polynomials,  that  their 
parameters  occur  nonlinearly  and  their  determination  in  fitting  problems  re- 
quires iterative  procedures  and  there  are  various  practical  difficulties . 

The  fact  that  best  rational  approximations  on  discrete  sets  do  not  always 
exist  must  be  kept  in  mind.  Lawson  states  that  he  believes  that  the  use  of 
rational  functions  for  fitting  discrete  data  will  largely  be  supplanted  by 
the  use  of  spline  polynomials . Rational  functions  have  been  very  successfully 
used  as  approximating  forms  for  some  analytic  functions,  and  the  algorithms 
for  computing  these  fits  are  well  covered  in  the  literature  but  the  effective 
design  of  such  approximations  depends  more  upon  a thorough  understanding  of 
the  function  being  approximated,  leading  to  the  use  of  special  identities  and 
changes  of  variables  than  upon  the  actual  computation  of  the  approximation. 
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! All  of  the  polynomial  parameterizations  are  candidates  for  use  in  rational  i 

function  parameterization.  There  is  also  the  possibility  of  using  continued 
, I 

t j fraction  forms,  however,  these  are  frequently  unstable  and  must  be  tested  for 

growth  of  rounding  error  in  each  individual  case. 

Lawson  says  Spline  forms  have  been  the  subject  of  intensive  study  in 
recent  years.  Much  more  work  needs  to  be  done  to  evolve  the  best  strategies 
for  parameterizing  and  manipulating  splines  and  understanding  the  problem 
with  variable  breakpoints.  Splines  combine  extreme  flexibility  in  changing 
curvature  with  the  stability  of  low  degree  polynomials  and  linearity  of 
coefficients  (for  fixed  partition  points).  They  provide  a very  attractive  i 

apprxDach  to  general  data  fitting. 

Lawson  at  the  end  of  his  paper  makes  a few  "somewhat  random  observations", 

(1)  He  says  that  he  believes  that  in  the  realm  of  advances  in  approximation 
algorithms  the  development  and  exploitation  of  the  fast  Fourier  transform  for 

( 

; harmonic  analysis  and  synthesis  must  rank  as  the  single  most  significant 

advance  over  previous  methods.  (2)  The  numerical  superiority  of  modified 
’ Gram-Schmidt  orthogonalization  should  become  known  to  everyone  and  hopefully 

should  even  be  mentioned  in  math  texts  on  linear  algebra.  (3)  The  advan- 
tages of  the  Chebyshev  basis  relative  to  the  monomial  basis  should  become 
more  widely  known  and  exploited. 

J.  Hiller  in  an  article  "Is  Orthogonal  Expansion  Desirable?"  addresses 
itself  to  an  examination  of  the  desirability  of  orthogonal  expansion  in 
identification  and  a class  of  sub-optimal  control  problems.  He  says  that  , 

> there  is  little  difference  between  the  orthogonal  technique  and  a method 

I J 

based  on  the  direct  minimization  of  the  (weighted)  integral  of  error  squared 
or  some  quadratic  performance  criterion.  He  shows  that  the  integral  approach 
is  equivalent  to  a particular  method  of  matrix  inversion.  Hiller  points  out 
that  the  identification  problem  in  control  has  much  in  common  with  the  ' 

approximation  problem  encountered  in  filter  methods  applied  in  identification.  , 

^ A 

His  paper  addresses  itself  to  an  examination  of  one  such  technique-orthogonal 
expansion. 

Hiller  says  it  is  common  practice  in  design  and  also  in  signal  measure- 
ment to  determine  the  optimum  set  of  weighting  coefficients  for  a given  set 
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of  functions  of  expansion  by  requiring  that  the  integral  of  the  error  squared 

should  be  minimized.  This  criterion  of  optimality  is  often  chosen  for  no 

other  reason  than  that  it  leads  to  tractable  mathematics  whilst  satisfying 

the  rather  vague  and  often  subjective  requirement  that  "error  should  be  small" 

Close  examination  of  many  approximation  procedures  reveals  that  there  is  often 

little  reason,  other  than  convenience,  involved  in  choice  of  criterion  of 

optimality.  He  shows  that  in  many  cases  the  requirement  of  orthogonality  is 

inconvenient  and  in  all  cases  amounts  in  principle  to  specification  of  the 

manner  in  which  a matrix  is  to  be  inverted.  He  uses  a simple  example  to 

illustrate  that  orthogonal  expansion  is  merely  a particular  way  of  carrying 

out  matrix  inversion,  viz.,  the  Cholesky  method.  Therefore,  to  answer  the 

question:  'Is  orthogonal  expansion  desirable?'  we  must  in  effect  pose  the 

query:  'Is  inversion  by  the  Cholesky  method  desirable?'  If  expansion  of  a 

real  function  is  being  carried  out  in  terms  of  real  component  functions,  the 

elements  of  the  coefficient  matrix,  F,  will  be  real.  It  may  thus  be  hoped 

that  all  computation  will  involve  only  real  functions.  It  has  been  shown  by 

Wilkinson  (1961)  that  if  F is  positive  definite  and  symmetric,  there  exists 

T 

a real  lower  triangular  matrix  L such  that  F=LL  the  symbol  T denoting  trans- 
pose. In  expansion  problems  symmetry  is  guaranteed  but  positive  definiteness 
is  not.  Any  attempt  to  carry  out  the  Gram-Schmidt  process  on  a system  de- 
scribed by  a non-positive  definite  F may  give  rise  to  the  appearance  of 
imaginary  elements  in  L 

Hiller  enumerates  the  following  features  often  claimed  (Kautz  1954)  for 
orthogonal  expansions: 

(i)  Convergence  is  rapid  and  uniform,  thereby  providing  an 
accurate  approximation  for  any  fixed  number  of  terms. 

(ii)  The  coefficients  a^,  a,  . . . etc.  do  not  depend  on  the 
number  of  terms  taken. 

(iii)  The  calculation  of  the  a^  is  simple. 
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(iv)  The  mean  square  error  is  minimized  for  each  set  of  items. 

With  respect  to  the  first  of  these  properties  Hiller  says  that  conver- 
gence of  the  orthonormal  expansion  method  will  only  be  rapid  if  the  pole 
distribution  of  the  approximating  functions  adequately  spans  the  pole  dis- 
tribution of  the  function  being  approximated.  It  is  not  necessary  that  the 

I 

pole  locations  should  coincide  for  the  error  measure  is  insensitive  to  pole 
positioning  provided  that  the  two  sets  of  poles  lie  in  approximately  the 
same  region  of  the  s plane. 

The  significance  of  properties  (ii)  and  (iii)  depends  on  the  use 
planned  for  the  expansion.  Property  (ii)  relates  to  the  additional  work 
associated  with  increasing  the  number  of  terms  used  in  an  expanison.  The 
main  reason  for  considering  the  independence  of  the  a^  on  the  number  of 
terms  as  an  advantage  is  the  thought  that  alteration  of  the  number  of  terms 
will  involve  only  partial  recalculation.  In  practice,  however,  it  is  unlikely 
that  this  method  would  offer  significant  advantages  unless  either  the  matrices 
were  of  large  order  or  very  fast  inversion  was  necessary  in  an  on-line  control 
application.  The  fourth  property  of  orthogonal  expansion  refers  to  minimi- 
zation of  the  integral  of  error  squared.  This  is  of  course  achieved,  in  the 
direct  approach. 

Peter  Swirling  in  his  paper  "Modern  State  Estimation  Methods  from  the 
Viewpoint  of  the  Method  of  Least  Squares"  states  that  his  paper  is  intended 
to  be  a guide  to  the  subject  of  modern  state  estimation  from  the  viewpoint 
of  the  method  of  least  squares,  including  an  exposition  of  the  relation  of 
this  subject  to  linear  filter  theory  and  a rather  comprehensive  account  of 
recursive  solutions.  He  says  results  will  be  stated,  interpreted,  and 
motivated,  but  not  derived  in  detail.  He  states  that  one  objective  of  his 
paper  has  been  to  state  a number  of  sidjstantive  results  which  are  in- 
sufficiently well  known  or  (in  some  cases)  about  which  there  has  been  a great 
deal  of  confusion.  He  gives  the  following  examples: 

Ic  Many  of  the  important  results,  including  the  fundamental  theorems 
of  recursive  state  estimation,  do  not  require  any  statistical  concepts  or 
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assumptions  either  in  their  formulation  or  in  their  proof.  For  those  results 
which  do  require  statistical  formulation,  the  great  majority  do  not  require 
the  assumption  of  Gaussian  statistics. 

2.  Even  when  the  problem  is  formulated  statistically,  there  is  no 
essential  difference  in  the  treatment  of  problems  where  the  state  is 
stochastic  and  of  problems  where  the  state  is  non-stochastic  or  "determin- 
istic": every  problem  in  which  the  state  is  a stochastic  process  can  easily 
be  reforumlated  as  a problem  of  estimating  a vector  of  non-stochastic  para- 
meters, yielding  identical  solutions. 

3.  Every  problem  in  optimum  linear  filtering  or  prediction  of  random 
processes  can  be  formulated  as  an  exactly  equivalent  problem,  yielding 
identical  solutions,  of  estimating  a vector  of  constant  parameters  by  the 
method  of  least  squares. 

4.  For  purposes  of  deriving  optimum  recursive  solutions  to  linear 
filtering  and  prediction  problems,  it  is  unnecessary  to  make  several 
assumptions  regarding  the  state  equation  which  have  been  widely  thought  to 
be  necessary. 

Swirling  says  his  second  objective  is  to  present  a self  contained  and 
comprehensive  development  of  the  subject  from  a viewpoint  which  differs  from, 
and  is  greatly  superior  to,  the  conventional  approach.  He  says  one  may  dis- 
tinguish two  approaches  which  have  been  employed  xn  developing  modern  state 
estimation  theory. 

1.  An  approach  in  which  the  basic  problem  is  taken  to  be  optimum 
linear  filtering  and  prediction  [here  Swirling  references  Kalman  and  Bucy's 
paper] . 

2.  An  approach  in  which  the  results  are  developed  as  elaborations  of 
the  classical  methods  of  least  squares  [here  he  references  his  own  paper]. 

Swirling  says  that  most  workers  in  the  field  have  started  from  the 
"linear  optimum  filter"  viewpoint,  ...that  the  superiority  of  development 
from  the  method  of  least  squares  viewpoint  is  evident  in  two  respects.  First 
it  easily  avoids  various  widely  prevalent  confusions  regarding  the  previous 
four  examples  (six  stated  in  paper).  All  of  the  points  of  those  examples  are 
rather  obvious  when  the  subject  is  approached  via  least  squares,  but  several 
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of  them  have  proved  difficult  to  grasp  from  the  other  viewpoint.  Second, 
he  says,  the  development  from  the  method  of  least  squares  viewpoint  leads 
directly  to  much  more  general  results.  As  an  example  very  important  in 
practice  is  the  treatment  of  recursive  solutions  to  non-linear  problems 
which  constitute  the  majority  of  practical  applications.  He  says  that  it 
is  well  known  that  the  algorithms  resulting  from  the  "optimum  linear" 
viewpoint  are  not  directly  applicable  to  non-linear  cases  but  must  be  mod- 
ified or  "extended"  to  be  made  applicable;  these  "extensions"  he  says  are 
just  the  algorithms  which  result  originally  from  the  method  of  least 
squares  development. 

The  last  (16)  sections  present  some  continuous  time  dynamics  for  linear 
stochastic  systems.  The  matrix  Riccatti  differential  equation  and  adjoint 
dynamical  systems  are  introduced.  It  is  felt  that  a conceptual  understanding 
of  both  the  continuous  and  the  discrete  time  processess  should  go  hand  in 
hand.  In  fact  the  design  of  multi  variable  digital  filters  could  benefit 
from  the  aid  of  understanding  how  corresponding  continuous  filters  behave 
(of  course  where  one  does  have  an  analogy).  Many  mathematical  operations 
can  be  built  into  special  purpose  hybrid  computers  or  mini-computers,  some  of 
which  are  or  can  be  analog  devices. 

As  an  example  of  the  state  vector  techniques  consider  a three  dimensional 
position  vector  with  rectangular  coordinates  in  time-varying  body-axes , an 
ortho-normal  base. 


x(t)  = [b^,b2,b2(t)]  x^(t) 


X2(t) 


^(t) 


X3(t) 


and  assume  that  each  of  the  three  coordinates  are  approximated  by  a d-dimen- 
sional set  of  fitting  functions,  that  is  for  constant  parameter  ^ 

Xi(t)  = <!^  a f(t)  (^^ 
i = 1,2,3 
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and  the  velocity  of  the  fitting-function  base  is 

f(t)^  = f(t)p> 

Hence  the  velocity  vector  becomes 

X = ^(t)[Vj^(t)  A + A V^]f(t^ 

3x3  3xm  3xm  mxm 

The  last  few  years  have  seen  the  emergence  of  a number  of  papers  applying 
Spline  functions  to  the  trajectory  estimation  problem.  These  functions  appear 
to  be  very  good  for  post-flight  processing  where  computational  speed  is  not 
of  prime  importance  as  in  real-time  trajectory  tracking.  The  bibliography 
lists  a number  of  these  spline  publications. 

For  the  real  time  applications  one  would  expect  the  Walsh  functions  and 
Block-Pulse  functions  to  come  through  in  the  lead  from  the  standpoint  of 
computational  time.  These  functions  are  discussed  briefly  in  section  40. 

They  are  natural  functons  for  digital  devices  and  have  enjoyed  much  success 
in  communications  theory  and  in  two-dimensional  filtering. 
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Section  1 

SOME  VECTOR-SPACE  METHODS  FOR  CONTINUOUS  FUNCTION  THEORY 

This  section  applies  some  of  the  vector  and  matrix  and  dyadic  anal- 
ysis techniques  from  raatricized  Gibbs  vector  analysis  methods.  Since 
pol3momials  are  vectors  rhe  base  elements  are  separated  from  the  coordi- 
nates and  many  operations  are  performed  between  rows  and  columns  of 
the  base  fitting  functions.  Inner  products  between  functions,  and 
matrices  of  inner-products  (or  metric  matrices)  are  used. 

Orthogonal  and  orthogonal-compliment  projectors  are  developed  and 
applied  to  the  recursive  Gram-Schmidt  process  to  obtain  the  orthogonal 
polynomials.  The  notion  of  polynomials  in  a given  base  and  their  coor- 
dinates in  the  "dual"  or  reciprocal  base  are  introduced  early  and  very 
naturally.  The  inverse  of  the  Hilbert  matrix  is  constructed  in  terms  of 
the  triangular  Gram-Schmidt  factors.  The  "weighted  Gram-Schmidt"  pro- 
cedure is  presented  from  the  point  of  view  of  a Gram-Schmidt  process  in 
oblique  bases  with  a S3nnmetric  metric  matrix  as  weights. 

Two  parallel  Gram-Schmidt  procedures  are  shown,  one  for  a continuous 
interval  and  the  discrete  analog  for  a finite  set  of  points  at  which  the 
fitting  functions  (base  elements)  ai’e  evaluated. 

Consider  a function  x(t)  expressed  as  a linear  combination  of  a set  of 
fitting- functiwis  fgCt) 


= <f(t)  a(tN  = i ^ f.a 


where  the  row- tuple  is 


<^(t)  “[foCt),  f^Ct)  •••  fd.i(t)] 


and  the  column- tuple  is 


a(t)(c^  = [aQ(t),a^(t) • •a^_^(t)]^  (2) 

In  general  we  will  consider  a(t)^  to  be  a constant  vector.  The  product 
of  two  functions  can  be  written  as 

Xj^(t)x2(t)  = ^a  f(t^  ^(t)  ^2^ 


SSSSgm 


and  the  inner-product  as 


rxjCt),x2ct)j  * I 


XjCt)  X2Ct)dt 


where  tj^,  and  t^  refer  to  the  back  and  front  of  the  tine  span. 


■ ^ 


lis 


where  the  dxd  matrix  is 


^‘ff 


'‘f 


‘I  \ [fo-fj.  •••.  fa.iCt)] 


d-1 


dt 


and  will  be  referred  to  as  the  metric-matrix, 
a scalar. 


Note  inner-product  yields 


V/e  also  have  the  norm  or  distance  function 


x^CtMt 


If  the  me trie -matrix  of  (Equation  7)  is  full  rank  (non-singular)  the 
set  of  functions  are  linearly  independent  and  from  a basis,  x(t)  is  called 
a vector  and  a^  the  coordinates  with  respect  to  the  base. 


2 


The  dual  base  is  given  by 


<^ct)  - cfct) 


C9) 


the  set  of  bi-orthogonal  functions,  since 


I » 1 dt 

v;here  I is  the  d square  identity  matrix.  As  an  exainple  of  the  utility  of 
this  concept  suppose  one  is  given  x(t)  continuous  over  the  interval  and 
asked  to  find  the  d coordinates  by  integration  (analog  computer)  then 


CIO) 


f^f 

f(^  xCt)dt  = 

f(3><^t)dt 

3 

and 


y> 


^ f 


fCt)>  xct)dt  . 


Cli) 


C12) 


(13) 


I- 

f 


The  solution  of  (Equation  13)  assumed  we  have  knowledge  of  the  fitting 
functions  and  can  generate  them. 

3y  Equation  (9)  in  Equation  (13) 

■f 


^ = f*(t^  x(t)dt  . 


(14) 


• 1 


1 


Equation  (18)  is  the  discreet  analog  of  the  metric-natrix  of  Equation  (12) , 
thus  one  is  lead!  to  a matrix  inversion  either  through  integration  or  dis- 
creet rank -one  (dyad)  summation. 

By  Equation  (17)  we  can  write 


i(^»  F*  x05> 
^ dxk  ^ 


ana 


F*  » (f’’f)"^f'^ 

where  the  generalized  inverse,  psuedo  inverse  or  (dual  bases,  in  sense 
of  column  space  vectors  of  F are  a base,  then  roiv  space  vectors  of  F* 
are  reciprical,  or  biortliogonal)  etc.  for 

F*  F » I 
dxk  kxd  dxd 

when  F is  full  rank. 

• • 

The  commute  of  Equation  (21)  is  a symmetric  idempotent  index  two 
projector. 

FF*  . P « 

kxk  _ 


and 


2 

P'^  = P 


Tlie  orthogonal  complement  projector  is 


and 


and 


I - P » P 


p-  a P 


?P  = 0 


(19) 


(20) 


(21) 


(22) 


(23) 


(24) 


(25) 


(25) 


r 


Using  Equation  Cl'-’)  Equation  (15) 

• rr\c^  - Ppp*^ 


rUiU 


^ ^ ^ » (i-n^  » . 


(27) 


(28) 


T»iC  continuous- function  analog  of  Equation  (27)  is  oLtained  by  using 
Equation  (14)  in  Equation  (1) 


x(t)  - <|(t)  " f*(^  x(t)c:t 


(29) 


or 


x(t)  = <f'‘(t)  ‘ f(^  x(t)dt 


(30) 


T.ie  fuaalcg  jctv/een  Equation  (27)  and  Equaticn  (30)  can  be  sharpened 
using  a r.atrired-rccrcsontations  of  Cibbs  dyads. 

Using  bars  over-vectors  to  r.oan  tic  old-fashicned  vector  a.ialysis  of 
Eucleadean  real  space,  enbed  Equation  (27)  in  a particular  basis  •/Iiicli 
is  oblique,  t-iat  is  the  rctric  (wnere  Jot  is  inner-product  or  cot  product) 


> < 


■Uo  ^ I 

ee 


I.  ( 
/ 


UJUSSm 


the  double  bar  is  in  analogy  to  Gibbs  use  in  three  space  for  a base 


ii  »■  i = 


C<^  j.  k) 


ii  » (i,  j,  k)  / 1 0 0 \ / i 

0 0 0 ( J 

\ 0 0 0 / \ k 


If  we  now  r^ace  the  bracketed-looking  symbols  of  Equation  (4)  for  inner 
product  by  ^ we  have 


* Xj(t)  X2Ct)dt 


and  Equation  (23)  becomes 


xCt)  =•  p(t)  0 xCt) 


where  the  operator  pCt)  is 


Note 


/ f -v 

® <^Ct)  - I - 

is  analog  of  Equation  • 

<e  . I -C^I  ^ 

that  is  the  operator  whose  aatrix  is  the  identity  matrix  in  all  bases. 
Note  the  binary  operator  (D  of  Equation  (41)  operates  on  the  two  ad- 
jacents,  on  the  left  a package  of  vectors  and  on  the  right  one  vector. 
Tiie  Gibbs  analog  is 


P • X ^ 


(<^p)  e)>  • 


where 


5^  • X 


~ m 

®1  * ^ 
- m 

^2  • X 


- « 

e,  X 

k • 


and  by  Equation  (41)  and  Equation  (42) 

x(t)  = pCt)  0 x(t)  » <^t)  [f*(^  0 x(t)J 

■ <^Ct)  [^'f(^x(t)dt 


(43) 


(44) 


(45) 

(46) 

(47) 


(487 

(4S) 


JWU.  n 


As  in  conventional  vector  analysis  any  invertable  linear  transformation 
yields  a new  basis  say  « 

<^t)  - <fCt) 

and 

. C^t)  . <f(t) 

I'Tiiere  the  dxd  matrix  can  be  time -varying  or  constant. 

For  the  constant  matrix  case 


or 


-1 


r^f 


- % 


S 


.fCt><tCt))dt 


where 


‘•ft 


fCt><l(t)dt 


for  constant  is 


The  connection  between  tiie  two  metrics  by  transoosing  Eouation  (50) 
t is 


or 


T 

M ■ T*  M 7 
••U  *f£  'ff  ft 


The  coordinates  of  tiie  vector  in  the  tMO  bases  likewise  is 


Using  Equation  (SO)  in  Equation  (53) 


or 


<(t)  . <?(t, 

*>f  • ^ 


If  the  transfoznation  matrix  T of  Equation  (50)  is  rectangular  instead  of 
square  say  of  size  dxg 


ajfct) 


T 

dxg 


then  Equation  (57)  becomes 


T 

gxg  gxd  dxd  dxg 


and  the  rank  of  Mj,|^  is  less  than  or  eqiial  to  tiie  rank  of  Mrf  (depending 
on  rank  of  T) . Ir  liff  and  T are  of  rank  d and  g<d  then  the  metric  matrix 
is  fullrank  and  invertible,  or  form  a basis  for  the  subsoace  of 
dimension  g. 

As  an  example  consider  Eoiiation  (61)  and 


^ f(^<^t)  . T 
t,  dxd  dxg 


^ If  we  are  given  xCt)  and  the  first  di  functions  and  seek  to  compute 
a^  the  best  we  can  do  is  to  approximate  the  dj  vector,  for 


r 

r 

f(t^  xCt)  dt  » 

t, 

u 


■ Sh  h * r3> 

I* 

and  since  ^2  is  unknown  we  can't  solve  for 


Itaere  the  sub-metric  fr 


, I X / ix  2X  ■ 

S \i^2/  L J !i.  , 


Tne  discrete-analog  problem  by  Equation  (66)  is 


XCtg) 

xCtj) 

xCtz) 


<f  Cti) 


<t  C*!;) 


^<CV 
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X 


^ ■ cfi''i5'‘'=r>-'=i%^ 

and  if  is  unknown  we  can  not  solve  for 

^2  ^1 


We  can  approximate^^  and  will  show  for  both  discrete  and  continuous 

case  ho>.v  one  approximates ^in  two  different  ways,  (i)  algebraic  or  orthoginal 
projections  and  (ii)  partial  derivatives.  Consider  the  discrete  case  first. 
By  Equation  C66)  let 


where 


xCt)  » x(t)  * xCt) 

/ 

= x^Ct)  + x^Ct) 
a r 


xjt) 


<f  (t)  ^ 
1^  '^1 

<fCt)  a> 
1^  ^1 


xCt)  » xCt)  - xCt) 


or 


If  we  select  to  lie  in  space  of 

a 


or 


Select  perp  to 

<5>  . 


’ X hence 


a ' a 


or 


l>'> 


B>a<“ 


a ^ ^ a 


Va  ^ 


But 


is  not  known  hence  we  cannot  compute  by  Equation  (86)  which 


is  the  orthogonal  projection  of  the  only  known  vector  onto  the  one- 
dimensional  unknown  space  spanned  by  x\  . 

If  we  solve  Equation  (81)  for  the  approximation  error  vector  x^ 


» (82) 


J. 


* J 

(83) 


(84) 


(8S) 


J 


(86) 


(87) 


then 


and 


<*>*<<*> 

and  taking  tlie  partial  derivative  with  respect  to  the  vector 

<3c  - <1, '<C 


or 


<1  .<x 


Clearly  Equation  (90)  nininizes  the  approxination  error  vector  for  it 
is  exactly  zero,  tliat  is 


x>.^  • 

However  t;xe  vector  is  a k+l  diDensional  vector  and  by  Equation  (78) 


V/e  assume  the  time  points  and  the  functions  ^^(t)  are  known,  hence  F, 
is  kno(vn  and^^  has  only  d^  ^ k unknowns  that  is  ®(^^^  . 


If  we  use  Equation  (79)  and  Equation  (92)  in  Equation  (31)  we  have 


k.xd. 


‘r“i 


Partition  into  its  column  space 


P,  ■ . • • • , ^ 


of  dj^  linear ly  indepeni’.ent  vectors  as  s'.ic\m  in  ^i<y.Te  2. 
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(S9) 


C90) 


C91) 


(92) 


(93) 


(94) 


t 


and  by  Equation  (96) 


where  tlic  nsuedo  inverse  is 


Fj  - (Fj  F^  F^ 
diXkj 

The  anr^roximate  vector  is 


^ - F^  aC^  = F^F^*  ^ 


(100) 


kixki 


hence  is  the  orthogonal  projection  of  the  given  data  vector  onto 
the  subspace  of  Fj^  for 


P.  . - F.F  * - - 

ijfl  1 1 fj^fj 


(101) 


F -F  - I 

diXdi 


(102) 


Using  Equation  (100)  in  Equation  (SI) 


(103) 


(104) 
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whicii  is  tlxe  same  os  Equation  (98)  solution  obtaineJ  via  algxbra. 

ALGEBRAIC  SOLLTIOi?  (continuous  case) 

By  Equation  (u6)  and  Equation  (76) 

x(t)  ■ x^(t)  ♦ Xy(t)  » x(t)  ♦ x(t) 
and  analogy  witli  Equation  (82) 


x(t)  • x^(t)  X 


Xj^(t)  x(t)  dt  - X x*(t)  dt 


xjt)  x(t)  dt 


x/(t)  dt 


v.’nere 


|x^  x(t)  - 0 - x(t)  ^Ct)  dt 


(1191 


(121) 


(12?> 


(12*^ 


xCt)  - X ft)  [x  ft)  x(t)  dt  - P (t)  © X 
a a a 


x^‘(t)  dt 


(12-.) 


Whicli  is  tlic  analog  of  Equation  (37);  l)ut  since  Xa(t}  is  unknoim  as  before 
we  can't  compute  x(t]  in  this  manner. 

PARTI i\L  DERIVATIVE  (continuous  case) . 

By  Equation  (120) 


xCt)  - x(t)  - x(t) 

and  if  we  attempt  to  duplicate  Equation  (89)  we  have 


(125) 


x(t)  (2  x(t) 


'£  -2 

x^(t)  dt 


« 2 

- x(t)  - x(t)  "dt 

and  to  take  tiie  partial  derivative  of  Equation  (126)  with  respect  to  x(t) 
7f(t)  ■ ’||{(t)  1/  1*^^^  " *^^^1 


Using  Equation  (79)  fox  x(t) , Equation  (126)  becomes 


(126) 


(127) 


l(t)(tlx(t)  - jx(t)  - 


(12S) 


Taking  tiie  partial  derivative  with  respect  to  the  constant  vector 
we  have  , 


Eqnating  the  above  qradient  to  zero  we  have 


Equations  (132)  and  (134)  are  the  analogs  of  Eauation  (119)  and  Ecuation 

(ino). 


ALGEBRAIC  SOLimOH. 
partial  notion,  thus 


We  can  sole  for  the  naraneters 


without  tile 


that  is,  biorthogonality  in  tlie  subspace. 


Tlie  parameter-vector  error  is 


»/hidx  is  the  continuous  analog  of  Equation  (113). 

LINEARLY  DEPE<DE?fr  FITTiriG  FlfilCTIOMS.  If  the  fitting  ftmctions  are 
linearly  uepedent  or  if  one  perfoms  the  transformation  of  Equation  (SO) 
where 


<^A(t)  - <^f(t)  T 
\ \ dxg 

where  g>d  and  ^^t)  are  linearly  independent  then 


<^t)  - <<)A(t)  T* 
^ gxd 


since 


T T*  • I 
d(g)d  dxd 

and  the  ccinnute  is  the  projector 


(141) 


(142) 


(143) 


T-T  - 

exg 


(144) 


TIte  psuedo^duals  of  Equation  (141) 

T* 


C14S) 
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T*  ^><^dt 


(146) 


(D  <C^(t)  - T*T  - 


(147) 


Tlie  psuedo-metric  of  Eqviation  (141)  is 


i(^<^t)ut  - II^^-  T 

^ gxd  *^dxg 


(148) 


and  the  psuedo  inverse  of  the  metric  .since  the  right  hand  side  of 
Equation  (148)  has  three  full  rank  factors , is 


M*  - T*  .•  tT* 

‘\l  ^ “ff  ^ 


(149) 


A psuedo-sinilarity  matrix  relation. 

V.'e  can  now  express  the  psuedo-dual  of  Equation  (145)  as 


(ISO) 


{/EIGjTED  IICIER  PRODUCT.  If  v/e  use  the  standard  notation  for  inner 
proiiuct  following  some  of  the  techniques  of  Erdelyi  (for  real  functions 
of  real  variables) 


f^j(t)  • f(t.d) 

where  t is  the  "polynoBiinal  argument'’  and  d is  tiie  degree  of  the  fitting 
functions,  and  a weight  w(t)  which  is  non-negative  on  the  interval 
(t^.tf).  we  may  associate  the  inner  product 


(ISl) 
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if 


fd^(t)  fd^(t)  w(t)dt  . 


fj^Ct)  ■ 1 and  dj^  ■ d2 

tlien 

r^f 

w(t)  > 0 


is  the  standard  requirement  on  the  weight  function. 


Package  wise  one  can  extend scalar  product  to 


CfCt) 


)>.<1 


fCt))  2 


wct)  fc^<;fct)dt  - M^^ct^.t^) 


hence  on  a base  or  a s/sten  of  fitting  functions  one  can  consider  C&iia^- 
alibi  concept)  a base  diange  occurred. 

Tae  teninology  of  the  fitting  fimctions  £(t,d)  and  base  functions  will 
be  used  interdiangeably. 

Clearly  the  weighted  metric  of  Equation  (155)  can  be  considered  a base 
diange 

<|(t)  - <fCt)  W(t)**  . 

If  the  metric  matrix  of  Equation  (155)  is  diagonal  the  system 
or  set  of  fmctions  (bases)  are  said  to  be  orthogonal,  if  the  matrix 
is  the  identity  the  system  is  said  to  be  an  ortho-nonaal  system,  that  is 


M 


U 


M 


i.1 


(titj) 

(tit2) 


a D (diagonal)  orthogonal 
m I crtho-nejmal 
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Evei)'  orthojonal  systen  can  be  nomalized  by  replacing 

act)  - — ii 

du  llAjll 


C150) 


wiiero 


^‘2  h 
ij(t)dt 


Eloneiit-v/ise  the  ortlionomial  condition  of  Eciuaticn  (159).  is 


Cx^Ct),  £.Ct))= 


0 if  i j1 

}.  ^ = U 


(160) 


(161) 


V/e  find  alias,  alibi  confusion  in  effect  in  tlxe  standarr’  liturature 
of  linear  vector  spaces  vihen  the  base  vectors  are  surpressed  and  a vector 
is  represented  as  a coliEin  vector  or  the  transpose  as  a tom  vector.  Consider 
the  equation 


yC^  - A 

nxn 

tchere  (1)  can  be  the  sane  vecter  (or  point)  '.lith  coordinates  in  a nev/ 
base,  or  (2)  ^ can  be  a different  vector,  the  irage  of  ^ under  the 
transfomation  A as  sho'vn  in  Figure  ( 3 ). 


(162) 


in 


S piP LE  SETS  OF  P0LY?10MI ALS . Throughout  the  report  the  definition  of 

Rainville  (page  147)  will  lie  used,  A set  of  polynonials  {f(i(t)}  ;d»0,l  ,2  ... 
is  called  a simple  set  if  fjCt)  is  of  degree  precisely  d in  t so  that  the 
set  contains  one  polynwnial  of  each  degree.  One  immediate  result  of  the 
definition  of  a simple  set  of  polynomial  is  that  any  polynomial  can  he 
expressed  linearly  in  terms  of  the  elements  of  that  simple  set.  Painville 
proves  the  following  theorem  (not  proved  here). (73) 

THEOREM.  If  {fd(t)}  is  a simple  set  of  polynomials  and  if  x(t)  is 
a polynomial  of  degree  m,  the/e  exist  constants  Cj^  such  that 

- m 

x(t)  = I C^.  f^(t)  . 
k=0 


where  msd. 

ORTHOrONAL  POLYNOMIALS,  VECTORS,  AND  MATRI CES,  VIA  GRAHM  SCHMIDT  ANP 
TRI^If^ilLAk  DE  COMPOS  I tioks.  Tliis  section  wilT~cbnsicler  some  procedures  i‘or 
talcing  any  set  of  vectors  and  obtaining  an  orthogonal  set.  In  some  cases 
the  vectors  are  polynomial  vectors  as  linear  combinations  of  base  polynomials 
that  is 


where  x(t)  is  a vector,  fjCt) , f2(t)  •••  are  considered  vectors.  The  set 
of  vectors  lead  to  symmetric  "metric"  matrices.  Hence  considerations  of 
Gram  -Schmidt  and  related  orthogonal  procedures  for  matrices  is  part  of 
the  same  considerations.  Rather  than  restrict  the  vectors  to  be  polynomials 
or  classical  Gibbsian  vectors  of  Equation  (31)  through  Equation  (48)  the 
inner-product  symbol  will  be  at  times  taken  to  be  , and  arbitrary  types 
of  vectors  designated  with  a single  bar  on  top. 

GPAM-SniMIDT  ORTllOGONALIZATION  is  a classical  mathematical  technique 
for  solving  the  following  problem:  _Given  a sequence  of  vectors  (linearly 
independent  or  linearly  dependent) (fj •••  ?d^  produce  a mutually 
orthogonal  set  of  linearly  independent  vectors  {si,S2»S3,  •••  Sg}  where 
g<d  such  that  for  k=l,2,  •••d,  the  set  {?i,f2»^3»  •••  fk^  having  rank  ft 
where  ft<k  spans  the  same  ft-dimensional  subspace  as  the  mutual  orthogonal 
set  {ii,S2,  •••  sj^}  (having  full  rank). 


31 


Consider  the  case  where  the  set  of  vectors  <^)f  is  full  rank  hence 
forms  a base,  then  for  any  f>ill  rank  matrix  B we  have  a new  base  or 

<b  - <f  B 
^ ^ dxd 

we  have  d^  free  choices  for  the  coordinates  of  in  the  base  as 
entries  in  the  B matrix  (subject  to  condition  B-1  exist).  If  we  desire 
a new  base  such  that  the  connection  matrix  is  triangular  we  arc  constrain* 
ing  (d2-d)  of  the  new  coordinates  to  be  zero*  or 

2 

<b.<^  Tb.i  b?2  ...  b^n 


(165) 


(166) 


...  0 b. 


d A 


>1  “ ••*  ^d^ 


b2  - (fi.f2.  •••  V 


(167) 


(168) 


Transposing  Equation  (165)  for  triangular 


1 

(169) 

and  forming  the  symmetric  matrix  of  inner-products 

T 

\ 

^ ® <b  . bJ  f>  CS  <1  "i 

(170) 

or 

1 

'ii,  ‘ "tf  h ■ 

(171) 

•» 

2 

Now  a symmetric  matrix  can  have  (d  +d)-5  independent  entries.  If  we  put 
the  further  c^straint  that  the  symmetric  metric-matrix  be  diagonal,  that 
is  that  the  vectors  of  Equation  ( 16^  be  orthogonal  we  have  d (non-zero) 

choices  on  the  main  diagonal;  and  the  remaining  upper  triangular  entries  of 
Equation  (166)  are  uniquely  determined. 

« • 

For  example  there  exist  many  2x2  upper  triangular  matrices  of 

Equation  (166)  such  that  jc  upper  triangular  and  full  rank  and  such 

that  the  new  base  vectors  <Cb  are  not  orthogonal.  Suppose  the  metric 
of  the  vectors  is 

•• 

« / 1 cos 30°  \ 

(172) 

\ cos 30°  (I)  / 

as  shown  in  Figure  (1) 
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and  construct  the  new  base  as 


bi  - 2fj 


‘'2  " ^^1  * ^2 


or 


\b  “ 


4 

2(2+C30°) 


2(2*C30O) 

5+4C30O 


which  is  non-diagonal. 

Note  that  in  Equation  (174)  v;e  assigned  the  four  values  to  the 
triangular  matrix  B. 


In  general  for  the  2x2  matrix  we  have 


on  fotir  dioices  of  b^j ; the  triangular  constraint 


- 0 


leaves  3 free  choices  for  the  B,  matrix,  or 

L ’ 


and 


/•ul  ^2 

gll(b.i) 


^•1^^11^*2'*'^12*’*2^ 


b^l(gllbJ2*gl2b?2)  (b}2)^gll*2(bJ2b?2)gi2*(b?2)^gp 


where  we  are  given 


the  f subscrips  supressed. 
Let  the  grammian  matrix 


T 


The  diagonal  constraint  or  equating  off>diagonal  elements  is 


8l2bb  ” ® “ 82ibb  “ *812^^2^ 


(184) 


or(clearly  b.  cannot  be  zero) 


0 - giib}j2  *512^-2 


(185) 


*12  .2 

8ll  ' 


(186) 


1 2 

(clearly  gjj  ^ 0).  For  full  rank  b.^  and  b.2  must  be  different  fjgm  zero, 
hence  by  Equation  (186)  bl2  can  be  zero  only  when  gi2“0*  or  the  base  is 
orthogonal.  Thus  the  constraint  of  Equation  (184)  plus  the  constraint  of 
Equation  (178)  leaves  two  free  choices  of  coordinates  in  the  b matrix, 
namely  bti  and  by  Equation  (185)  b?2  (or  bJ2)  when  Mff  is  non-diagonal-the 
case  of  interest. 


We  thus  have  ( 


<b  - <1 


1 2 

which  is  a function  of  b.^  and  b.j,  and 


(187) 


|>  • <1  " ( 


(188) 


or  by  Equation  (187) 


! 4 . 


B 

g 

2:i2 


(189) 


The  vectors  are  orthogonal,  the  only  unspecifieds  are  tlieir  magnitudes. 
If  and  b?2  are  chosen  the  magnitudes  or  dji  and  d22  (squares  of  magnitudes) 
are  uniquely  determined.  Likewise  if  the  d^x  and  d22  <Aosen  the  unique 
iq>per  triangular  matrix  Bg  can  be  determined. 

For  a full  rank  set  of  and  the  Gram-Schmidt  constructions  pro- 
cedure that  is  for  all  subsets  (fj,  ...  f^)  and  (gj,g2»  •••  g*)  for 
t s 1,2,  d span  the  same  subspaces  quantities  one  can  also  write 


f,  - f!i  Sx  - <^  ( fj, 


0 

0 


(190) 


h • f-2  *1  * «2  ■ <1  / ^-2  \ 


I 0 


or 


<4  • <( 


(191) 


By  Equation  (189)  in  Equation  (191) 


<1  ■ <1 "a  ' <1 


(192) 


B F.  - I 
g A 


(193) 


•"a  “ • 

A g 


(194) 


By  Equation  (190)  and  (194)  w£  seee  that  the  inverse  of  the  upper 
triangular  Gram-Schmidt  coordinate  matrix  is  also  upper  triangular. 


As  an  exercise  one  can  show  that  the  Bg  matrix  of  Equation  (174) 


2 2 


0 1 


(195) 


has  the  inverse 


-1 


0 1 


(196) 


Transposing  Equation  (191)  using  (194) 


(197) 


and  forming  the  synmetric  metric 


f>®  <1. 


(198) 


ill 


^ ® <?  ■ V ' / ■“ii  » 


(201) 


*22 


*dd 


|: 

Iff 

ill' 

u t 

f 

•i 


The  symmetric  "metric  matrices"  or  matrices  of  inner-products  of  the  vectors 
with  themselves  are  called  Gram  matrices ^ moment  matrices  etc.  The  matrices 
Mff,  Mbb  %g  are  positive  definite  since  they  represent  inner-products 
(reals) . 

Positive  definite.  A matrix  M is  said  to  be  positive  definite  if  for 
all  non- zero  vectors  7 or ^ 


M > 0 


(202) 


A 

: 

I- 

n 

r^. 


! 


Is 

.il 


where  > is  greater  than  symbol,  also  written  in  most  texts  books  as 


X MX  > 0 


(203) 


where  x is  understood  to  be  a column  vector  and  superscript  T is  transpose. 

Wendroff  proves  a theorem  wi  page  126  of  his  book  (stated  here  but  not 
proved  since  most  of  theorems  become  geometrically  obvious),  (89) 

THEOREM.  If  M is  symmetric  matrix  and  positive  definite  there  exists 
an  upper  triangular  matrix  U such  that 


M » U^U 


(204) 
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Clearly  if  we  partition  the  i5)per  triangular  matrix  U into  its  column  space 


(205) 


uJj  uJj  Jj  ...  ufj 


0 

0 0 u?. 


and  transposing  Equation  (205)  into  a column  of  row  vectors 


u’’. 


Using  Equation  (205)  and  (206)  in  Equation  (204) 


M “ U^U  » 

'^1  ^2 


(206) 


(207) 


I 

K 


Define  the  row  of  Gibbsian  - type  vectors  (not  n-type  column  vectors) 
as 

= (Uj^,  u^,  Ug,  . . . u^)  =<^  U 

= <e  .^2*  • • A Vd^ 


and  transposing  Eq  (208)  , 
.>  = 


"^1 

®1 

^2 

T 

= U 

®2 

• 

• 

• 

• 

• 

• 

^d 

id. 

u";> 


the  background  base  ii 


where  rne  oacKgrouna  \.e  case  ii 
. <>^e  = I 

that  is  orthonomal. 

By  Eq  (208), (209)  and  (210) 


(208) 


(209) 


(210) 


(211) 


u'^U  = u"^  . <^  = U 

Using  Eq  (211)  in  Eq  (202) 

U^U  3^  = X . X (212) 

where  the  column  vector  x in  the  base  has  coordinates  given  by  Eq  (213) 
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I 


or  transposing 


X » 0^ 

and  the  inner-product 


(2 


X 


X » x^ 

■ <C*'uu^ 


SEQUENTIAL  GENERALIZED  CRAf^SCHMI DT  PROCEDURE.  Consider  a sequence  of 
linearly  indepedent  vectors 


C^l*  ^2*  ^3*  ^4  ’ * * (2 

where  we  desire  to  construct  the  matrix  of  Equation  (189)  or 

<f-  . (2 


we  will  construct  an  orthonormal  sequence.  Let  the  first  unit  magnitude 
vector  be 


By  Figure  2 tJjore  exists  a scalar  such  that 


^2  “ ^*2  * ^2 


f^il)  = f 2 “ ^ ^-2  " 


l-V 


and  we  take  the  second  orthonoxmial  vector 


(tj  ® f2)-> 


By  Equation  (221)  there  is  one  unknown  coordinate  1^2  of  fhe  vector  fj 
in  the  two  dimensional  subspacespanned  by  fi  and  £2.  Taking  the  inner 
product  of  Equation  (221)  with  fj 


■fj®  f.-o-r-f.  -fj 


1-) 


.1  ^1®  ^2 

A.-  a — — y 

fj® 

and  Equation  (224)  in  Equation  (221) 


f,(l)  - (£,,£,) 


f,®  fj 


T 


f2(l)  - f] 


^ I 


- 1 © f,  ~ 


^1^1©  ^2 


fl©fl 


(226) 


(227) 


or  factoring  out  / 


f.(l)  - I 


© 


(228) 


Where  the  operator  I is  the  "idempotent”  operator  with  respect  to  the 
inner-product  used,  that  is 


i®f2  “ h 


(229) 


We  need  the  rank-one  projector 


: ^1^1 

P(i.i)  = •=— 


f ©^1 


(230) 


where 


(231) 


which  is  idempotent  for  all  vectors  lying  in  the  f^  subspace  since 


P(l.l)  © V - fjfj*'®fjA  = fjX 


(232) 


(that  is  the  operator  P leaves  the  vectors  f.X  alone)  , since  the  inner- 
product  of  the  base  vector  and  its  dual  is 


fl  .fj  . 1 . 


(233) 


The  operator  is  called  idempotent  (index  2)  since  (see  Equation  (144)) 
for  example) 


PQ?  a P^-  P . 


(234) 


Since  Pjj  is  a rank  one  linear  operator  or  transformation 
Snd  every  linear  transformation  has  a matrix  of  (real)  coordinates,  imbed 
f j in  the  base  or 


f e > *=  f , 


(235) 


where 


<^  = (1,  0,  0 . . .)  (236) 
1^ 

and  the  dual  base  with  respect  to  the  <^f  base  (recipical  base  vectoi*s) 
is  ^ 

® <d)f  )■'  f> 

■ ««  t> 

or 


(237) 


r * 

^1  “ 


(238) 


Hence  in  the<r  f base  and  its  dual  the  matrix  of  the  operator  is 


where  the  dxd  matrix  (dyad)  is 


With  respect  to  the  d>dimensional  subspace  or  (full  space)  spanned  by  the 
vectors  of  the  sequence  of  Equation  (217) , the  f operator  can  be  written 


where 


for  any  vector  expressed  in  the  base  as 


The  ortho, 
projector  is 


fonal  complement  projector  (with  respect  to  the 
rom  Equation  (^28)  * 


Pai-P.I- 


(245) 


and  is  idempotent 


P © P - P . 


(246) 


the  orthogonal  complement  projector  is  related  to  the  projector  P as 


P © p - 5 . 


Returning  now  to  Equation  (228) 


fj(W  ■ fj 


and  transposing 


fj  . fj  . £2  ® 

since  the  projectors  are  symmetric  that  is 


ST*  - 

P * P 


Taking  the  inner>product 


^2(1) ^2  • ^2  ® ^110^11®  ^2 


(251) 


(252) 


£2(1)  i - fjfj 


fl®fl 

f2©f2  - f2@fifi(Df2 
"^10^ 


(253) 


By  Equation  (225) « Equation  (248)  and  Equation  (245) 


f 2 - f 2 - 


® ^2 


(254) 


and  by  Equation  (222) 


i2  - ^2  . 


(255) 


Note  that  when  £2  is  small  in  magnitude  we  are  in  computational  trouble. 
Using  Equation  (253)  and  (254)  in  Equation  (255) 


Sj  . . 


fl®fl 


^ h®  h 


(256) 
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Consider  next  the  third  vector  s 


Since  S3  is  to  lie  in  the  three  dimensional  subspace  spanned  by 
and  must  be  perpendicular  to  and  I2  have  by  Figure  3 


FIGURE  6 


solving  for 


The  inverse  matrix  is 


using  Equation  (271)  in  Equation  (270) 


I 


*22*13  ■ *12*23 
^■*12*13  *11*23 

Using  Equation  (273)  in  Equation  (263) 


^*11*22"*12  ^ 


(273) 


£3(1.2)  . 


’*22*13  * *12*23 
*11*22  ■ *12 


*12*13  ~ *11*23 
*11*22  ■ *12 


t 

L 


(274) 


The  introduction  of  the  gjj  elements  obscured  the  projective  aspects 
of  the  problem,  hence  returning  to  Equation  (263)  and  taking  the  inner- 
product  with  f^(2^  we  have  by  partitioning 

® £3(1.2)  - f*(^®[<^)f.  f3  j (27S) 


or 


(276) 


where 


£^(^  - ^£(^  © <2)f  £()> 


(277) 


54 


and  is  perpendicular  to  both  fi  and  f2  and  their  duals.  By 

Equation  (276) 


x(^-  f*(^  (D  £3 


(278) 


Using  Equation  (278)  in  Equation  (262) 


£3(1,2)  - £3  - (fj.f^)  X(p> 


(279) 


or  Equation  (278)  in  Equation  (279) 


where 


£3(1.2)  - £3  - <f)f  £*(^  0 £3 

^3(1,2) .[; . <2)f  f, 

£3(1,2)  - P(1.2)  0 £3 

P(l,2)  - i - P(l,2) 

p(i,2)  .<fr(^-  fjfj(l2)+ 


(280) 


(281) 


(282) 


As  be£ore  Equation  (281)  and  Equation  (282)  are  projectors. 

The  matrix  o£  the  rank  two  projector  P(l,2)  in  the  £ull  base  can  be 
written  a number  of  ways,  for  example  the  two  vectors  in  the  full  base  are 


(283) 


and  the  two  reciprocal  vectors  are 


Packaging  Equatioi  (283)  in  the  two  dimensional  subspace  spanned  by 

<f)f 


(f  f ) - <f)f  I 
^ ^ ^ 2x2 


or  in  the  full  d> dimensional  space  spanned  by  all  the  vectors 


<> 


<^f  - <^)f 


I 

2x2 


(d22)x2 


<3 


Using  Equation  (284)  in  Equation  (282) 

P(l,2)  - <2)f  2^2  ?*(1.2)(^  - <^)f  M-^  f(^ 


By  Equation  (288)  we  see  that  the  minimum  rank,  minimum  space  matrix  is 
the  2x2  identity  matrix,  that  is 


when  the  operator  is  expressed  ijua  base  and  its  dual  base;  when  the  operator 
is  expressed  completely  in  the  base  and  the  transpose  the  2x2  matrix  is 


®11  ®12 


*21  *22 


just  as  the  coordinates  of  a vector  look  different  in  different  bases,  so  also 
a matrix  does. 

We  can  also  express  the  operator  P(l,2)  in  coordinates  in  the  full  <^)f 
space  and  the  full  f*((^-  base.  Transposing  Equation  (287)  ^ 


f(^  - eI  f(^  . 


The  full- reciprocals  are 


f*(^  ® <d)f  j f(^ 

- f(^ 

dxd 

or 

f(d^  “ . 

Using  Equation  (293)  in  Equatim  (291) 

f(^  ■ Mfd 

2xd  (dxd) 

Using  Equation  (294)  in  Equatim  (285) 

f*(l,2)(^-  Ej"^  f*(^ 

2x2  2xd  dxd 

or  Equatioi  (295)  in  Equation  (282)  yields 


(296) 


i 

I 


?C1,2)  - <d)f  Ej  M‘^  Ej*’’  f*^ 

dx2  C2x2)(2xd)dxd 

or  the  matrix  of  the  projection  operator  of  Equation  (296)  in  the  full 
space  base  and  its  dual  is  the  dxd  matrix 


eJ 


“1  ‘'I  “ff 

dx2  (2x2) (2xd)  dxd 


M 

2x2 


,-l 


0 

2c(1.2) 


j^d-2)x(2)  (d-2)(d-2) 


Mff 

dxd 


or  partitioning  such  that  sub-matrices  are  of  compatible  sizes, 
dxd 


Ej  M-‘  Ej'f 


I 

2x2 


0 

2x(d.2) 


0 0 
(d-2)x2  (d-2)(d-2) 


Since  orthonormal  bases  are  self  dual  that  is 


(297) 


(298) 


the  nicest  base  to  express  the  operator  P(l,2)  is  in  the  Schmidt  orthonormal 
subspace  base 


(299) 


even  in  the  full  Schmidt  base  one  has 
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S&iiiiiHMfiHiiaiiiiliiiliBi 


f 


L,2)  - <d) 


s I 
2x2 


0 s 
2x(d-2) 


. 


(300) 


0 0 
[(d-2)x2  (d-2)(d-2)J 

Returning  now  to  Equation  (264)  and  Equation  (280)  the  third  orthonormal 
vector  is 


£3(1.2) 


■^sCDP 


®P(l,2)0f, 


(301) 


Consider  the  vectors  of  Equation  (226)  and  Equation  (274)  and  the 
matrix  of  vectors  not  normalized 


|^fj/2(l)  .£3(1,2^-  (gl.g2.g3)  - <3)g 

. <f,i  r 1 


“^22^13*^12^23 

®llS22“^12^ 


2i2®13“®11®23 


®11®22"®12 


(302) 


(303) 


<1  -<f 


(304) 


which  is  called  a unit  iroper  triangular  matrix. 
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The  orthonormal  Gram-Schmidt  vectors  can  now  be  obtained  from  Equation  (303) 


The  recursion  on  the  projectors  can  be  written  in  terms  of  the  orthonormal 
vectors  as 


f-(l)  - f,  - P(l)(Df, 


In  terms  of  summations 


’’  ■' 


• • 


• • 


k-1 


8k  “ •••  \ - I ®i®i®^k 

j=*l  •' 


• • 


• • 


• • 


d-1 


Sj  - fj(i.2.  •••  a-1)  " fj  - J s.Sjg 


©f 


where  k = 2,  3,  •••  ^ 


f.  (1,2  ...  k-1) 


|f^(1.2  ...k-l)||  Ijg^ll 


and 


81  “ ^1 


and 


"1  - 


\\\  II 


Continuous  Gran-Schmidt  Polynomials  (0.1). 


I 


Consider  the  set  of  base  vectors  (the  monomial  base) 

(1. 1. 1^)  -<1 

for  a vector 

x(t)  (1,  t,  t^)  a(^ 

with  inner  product  on  the  bases  defined  as  the  Hilbert  matrix 

1 p 

”ff  “ ^ ® “ f =«  1 1/2  1/3 


By  Equation  (310)  and  Equation  (311) 


gl  - Si  = fi  - 1 


1 

1/2 

1/3 

1/2 

1/3 

1/4 

1/3 

1/4 

1/5 

since 


i - 1 - <f)f  e('K 


(312) 


(313) 


(314) 


(315) 


^1®  ^1  “ ^ ® <^5  5^ 

- <f)e  e(^  - 1. 

^ 3x3  ^ ^ 

By  Equation  (308) 

«2  " ^2  ■ *1*1  ® ^2 


(316) 


(317) 


(318) 


and  by  Equation 


r 


Using  Equations  (315) ,(327) ,(329)  and  (330)  in  Equation  (328) 


The  noi«  of  the  vector  is 


Using  Equation  (334)  in  Equation  (332) 
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Applying  Equation  (348)  to  the  matrix  of  Equation  (337)  or 


and  using  Equation  (353)  in  Equation  (356) 


•s'*  • “5^  ?>  ® <1 


(357) 


or 


«ffl 


For  the  3x3  case  of  Equation  (337)  and  Equation  (313) 


-1 


or 


-1 


1 

■/T 

/r 


1 

0 

0 


0 

2/r 

-6^ 

1/2 

*^/6 

0 


0 

0 

6.^ 


1/3 

/3/6 

/5/30 


1/2 

1/3 

1/3 

1/4 

1/4 

1/5 

or 


(358) 


(359) 


(360) 


(361) 


(1.  t.  th  » <s 

\Suppose  we  now  have  the  coordinates  of  a vector  in  the  base  sav 
a^^  is  known,  where  ^ ' 

x(t)  - (1,  t,  t^)  a(^ 

and  we  want  the  coordinates  in  the  Schmidt  base,  then 

x(t)  » a^  . ^ (3^2) 

or 

^ @ x(t)  - a^  - ^ ©C^f  ^ 


(363) 


by  Equation  (356)  in  Equation  (363) 


(364) 


CONTINUOUS  tPDIFIED  LEGENDRE  POLYNOMIALS  The  definition  of 

the  inner-product  as  bef'ore  but  on  the  interval  1-1,1] 

-^1^1  1 

and  the  ensuing  orthogonal! zati on  process  generates  a set  of  polynomials 
bearing  the  name  Modified  Legendre  Polynomials.  The  matrix  for  the  3x3 
case  is 


^®<f  = 


1 / 1 


t (1.  t,  t‘)dt 

-1  \ t2  / 


(365) 


(366) 


2/3  0 


If  one  applys  the  equations  for  the  general  Gram-Schmidt  procedure 
of  Equation  (308)  for  the  metric  of  Equation  (366). 


By  Equation  (308) 


’1  “ ^1  “ ^ ° 


(367) 


and  normalizing 


X 


(368) 


Ill 


We  will  now  obtain  the  inverse  of  the  base  connection  matrix  6.  of  Equation 
(383).  Transposing  Equation  (383) 


T '' 
- B ‘ f 
8 ^ 


and  by  Equation  (384) 


<f  ■<! 

operate  on  Equation  (390)  with 

8^®  <3  ■ ^©<^8 


* D B 
8 8 


Use  Equation  (389)  in  Equation  (391) 


B ^ (i)  D B 

8 \ 8 8 


(389) 


(390) 


(391) 


(392) 


(393) 


T -1 

B ‘m..  « D B ^ 
8 8 8 


-1  -1  T 

B * ■ D B ‘ M-- 

g 8 8 


and  for  the  3x3  case  under  consideration. 


■ * 


(395) 


(396) 


f 


^ GRAM-SQMOT  PROCEEDURES  IN  OlFPEBENT  BASES.  If  the  sequence  of  vectors 
O"  Equation  are  known  in  a dlrterent  background  base  that  is  for  each 


<1^ 


then  for  the  set  we  have 


<^)f  .<d)E 


(397) 


where  F is  the  dxd  matrix  of  coordinates  of  the  vectors  in  the 
base,  whose  metric  matrix  is 


b^Ci)  <b 


«bb 


(398) 


Thus  by  Equation  (397)  and  Equation  (354) 


F » 


-1 


(399) 


and 


<(  ■<!»,  -<5  f B, 


(400) 


If  w define  the  coordinates  of  the  orthonormal  Gram-Schmidt  vectors 
in  base  as 


Sk  ■ F 
D S 


(401) 


then  Equation  (400)  becmnes 

<i  -<f  -CbSj 


(402) 


76 
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and  the  matrix  (of  coordinates)  Sb  is  said  to  be  orthonormal.  By 
Equation  (401) 


(406) 

(407) 

(408) 

(409) 

(410) 

(411) 


r 


T 


and  we  see  the  "familiar  decomposition  of  F into  an  orthonormal  matrix 
and  a triangular  matrix.  Transposing  Equation  (411) 


pf  - uV 


and 


» u'^^s  ’*’s,  U 
b b 


and  if  Equation  (407)  holds 


T T 
f‘f  = U U 


Transposing  Equation  (393) 


S J . B V 
0 s 


and 


T T T 

S.  S.  = B ‘f'f  B 
b b s s 


By  Equation  (398) 


■ «bb  ■ 


and 


»s'^»s"'  - ”ff  “ 


or 


Sb^b^  - 


i and 


(412) 


(413) 


(414) 


(415) 


(416) 


(417) 


(418) 


(419) 


(420) 
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Using  Equation  (426)  in  Equation  (425) 


*2-<l  1^  - 


(427) 


In  general  the  terms  with  respect  to  the  metric  of  the  inner>product 
are  straight  forward  when  applied  to  Equation  (308) , 


^TERMINATION  OF  THE  GIUW  SCHMIOT  FACTORS  OF  A MATRIX.  By  Equation 
(41  Ij  we  see  that  the  Grain>^chmidt  orthogonal!  zation  can  be  regarded  as 
being  another  way  for  decomposing  a matrix  with  orthogonal  columns  and 
a triangular  matrix  or 


F = S U 
dxd  (dxd) (dxd) 


(428) 


One  must  simply  be  careful  of  how  inner-product  is  defined.  Bierman  in 
reference  ( 85  ) introduces  the  notion  of  weighted-Gram-Schmidt  fact- 
orization of  the  matrices,  the  weights  are  with  respect  to  the  metric 
of  an  inner-product. 


MODIFIED  GRAM-SgiMICT.  Rice  in  his  paper  "Experiments  on  Gram- 
Schmidt  Orthogonal! zation"  states  that  surprisingly  the  Gram-Schmidt 
and  modified  Gram-Schmidt  show  distinct  differences  in  computational 
behavior.  This  is  particularly  remarkable  since  both  methods  perform 
basically  the  same  operaticxis,  only  in  a different  sequence.  Indeed, 
ignoring  computational  errors,  they  produce  the  same  set  (si)  with 
the  same  number  of  operations.  He  states  that  the  modified- Gram- 
Schmidt  method  is  more  natural  for  machine  computations  since  it 
econonizes  storage. 


Consider  the  sequence  Equation  (216)  and  set  the  modified  vector 


Si  - fi  - ii 


(429) 


and  the  unit  magnitude  modified  vector 


(430) 


ii 


Designate  the  initial  m sequence  as 

•••  fj) 


(431) 


Project  all  vecton  orthogonally  onto  fj  (except  fi)  select  the  components 
perpendicular  to  that  is 


(432) 


k»2,  3,  •••d 


\ (D  \ = p(i.i)  ® 


(433) 


and  tbf  complement  component  is 


f^d)  = (!  - P(l,l))® 


(434) 


Form  the  new  base 


= (fj, 


£2(1).  £3(1),  •••  £^(1)  £j(l)) 


(435) 


I£  we  normalize  the  £irst  two  vectors  we  have 


(436) 


S d) 

“2 

TiiT^ 


l|f,d)l 


(437) 


Now  orthogonally  project  all  vectors  fk(l)  for  k - 3 4 . 

and  select  the  components  perpendicular  to  fgCl)  that  is 

^(1.2)  - (f2(l)  f*(l))  © \ii) 

- (V2^  ® f^d) 


d onto  f2(l) 


and  tlie  perpendicular  component  is 


fkd.2) 


= ^2^)  f2(l) 

Ilf2d)ll 


Ci)  f,,(l) 


or 


\d.2)  - fj^(l,2)  * ( " . s^s^)  (i)  fj^(l) 

using  Equation  (434)  in  Equation  (440) 

fkd,2)  » ( I . 52^2)  © ( ! - 
» P(2.2)  © P(l,i)  © 

Note  that  the  product  of  the  two  projectors 
( " - S2i2)  Q ( I-Sjij) 

- i - Sjij  - i2S2  » P(l,2) 


(438) 


(439) 


(440) 


(441) 

(442) 


(443) 
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S5*5HHSHHL3ri2;; 


where 


V2  CD  Sjii  - 8 


(444) 


and  the  projector  P(l,2)  of  Equation  (443)  is  the  same  projector  as  in 
Equation  (281)  and  the  third  vector  is 

£3(1.2)  » 513(1,2)  - gj  » P(l,2)  © £3  , 

also  the  nomalized  vector  is 


ij  = 03(1.2) 


Form  the  set  of  base  vectors 


(445) 


(446) 


<^)51  = (fj, 


£2(1),  £3(1.2),  •••  £^(1,2) 


• fjCl.Z)) 


(447) 


Proceeding  in  the  same  manner  project  all  vectors 


\(1.2)  = f,,(1.2)  for  K = 4,5,6,  •••  d 

onto  £3(1,2)  and  select  perpendicular  components,  the  final  51  set  of 
base  vectors  will  be 

(d-n 

- (fl.f2(l).  ^3(1.2).  V^.2.3),  •••  £^(1.2.  ...  d-D)  (448) 


and  the  orthonormal  set  will  be 


<^)0  “ <d)i 


(449) 
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which  is  exactly  the  set  for  the  conventional  Gram-Schmidt  proceedure. 
Note  that  the  computational  pioceedures  were  different  for  this  modified 
proceedure  than  for  the  conventional  proceedures. 


The  modified  GRAM-SCHMIDT  recursive  algorithms  can  be  written  as 


HjCl)  = f j ® f^ 


(450) 


j =»  2,  3,  •••  d 


\(k-l) 

l\(k-l) 


k a 2,  d 


iiij(k)  = 51j(k-l)  - 0 iii^(k-l) 


j = k+l,  • • • d 


where  the  abbreviated  notation  is 


m^Ck-l)  S nij  (l,2,*-*k-l) 


TRIANGULAR  DECOMPOSITIONS  AND  MATRIX  INVERSICTJ  VIA  CHOLESKY  PROCEEDURE. 
There  are  many  many  chapters  in  numerical  analysis  texts  and  publications 
on  triangular  resolutions  of  arbitrary  matrices.  The  method  of  Cholesky 
are  generally  reserved  for  the  case  of  a symmetric  matrix  according  to 
Fox-  (30) 


Let  A be  a real  dxd  matrix  and  suppose  we  wish  to  solve  numerically 
the  linear  systems  of  equations 


1 x^  » 


(451) 


5 I 


I 1 


The  task  is  straight  forward  if  we  can  factor  A as 
A - LU 

i<0) 


(452) 


where  L ■ (itij)  is  lower  triangular  for  i «\j)  and  U ■ (u^j)  is 

upper  triangular  ujj  « 0 for  i^  j)  for  Equation  (452)  in  Equation  (451) 

(453) 

(454) 


where 


U ^ 

Although  one  must  solve  two  systems 


(455) 


and 


or 


(456) 


(457) 


(458) 


each  of  the  two  inverse  factors  has  a very  simple  form.  Thus  the 
solution  of  Equation  (451)  via  the  triangular  resolution  requires  the 
inverse  of  triangular  matrices. 


Theorem  1 is  taken  from  Wendroff  page  126  and  stated  without  proof. 
(Previously  stated  on  page  (39)). 


THEOREM  1.  If  A is  symmetric  and  positive  definite  there  exist 
an  upper  triangular  matrix  U such  that 


A ■ U^U. 


(459) 


The  general  formula  is 


u u ■ a - 7 u.  u. 
m mn  mn  v , xm  in 
i«l 


(463) 


These  relations  are  easily  derived  via  partitioning.  Partion  U into 
its  column  space 


U ■ I u^  , u , u^  • • • u^ 
cd  ^ d - 


T 

U - <vu 


giving 


“ij  ■ <*ij  - L "'"jj 


(464) 


i « 1,  2,  •••  j-1 


>ii  ■ I., 


giving 


“ii 


“ii  - J "ik>^ 

k«l 


(465) 


when  one  applies  the  algorithm  of  Equaticm  (462)  and  Equation  (463)  to 
the  (3x3)  Hilbert  matrix  one  obtains  the  factors  of  Equation  (360)  for 
the  Gram  polynomials  on  (0,1)  interval,  namely 


1 1/2  1/3 

1 

o 

o 

1 

1 1/2  1/3 

1/2  1/3  1/4 

S 

1/2  /7/6  0 

0 /y/6  /y/6 

1/3  1/4  1/5 

1/3  /y/6  /5’/30 

0 0 /S’/so 

(466) 


If  we  apply  the  algorithms  to  the  symmetric  circulant  matrix  as  an 
interesting  example 


2 

3 

1 


3 

1 

2 


T 

= u‘u 


(467) 


wh  s 


T 

u‘u 


0 

i 

54 


0 

0 

3/2- 


2 

i 

0 


3 

Si 

3^7 


(468) 


where 

i ■ 

thus  we  see  that  the  factors  of  a real  synmetric  matrix  can  be  imaginary. 
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GRAM-SaiMIDT  OF  THE  "DISCREET  METRIC  MATRIX"  FOR  THE  FITTING  FUNCTIONS 
OF  aTTS'CRECT'  SP'iW  8F  POINTS.  For  ccmsiderations  of  polynomials  orthogonal 
over  discreet  point  sets,  tlie  Graoi-Schmidt  proceedures  developed  in  this 
section  will  be  used  later  for  Legendre,  Laguerre  and  other  pol5moinials. 
Consider  the  "discreet  metric  matrix"  (also  called  the  normal  matrix 
in  least  squares  discussions)  of  Equation  (18) 


“ ^’ff  (469) 

dxk  kxd  d(k)d 

where  the  matrix  size  d(k)d  indicates  full  rank  factors  with  one  side  in 
k- space  where 

k ^ d. 

The  discreet  vector-matrix  equation  by  Equation  (15)  is 


One  can  solve  Equation  (470)  for  the  vector  a 
generalized  inverse 


by  computing  the 


(470) 


(471) 


where 


F 

dxk 


T . 

(f‘f) 


' F^ 


dxd  dxk 

one  can  also  obtain  the  generalized  inverse  as 


F 

dxk 


F^  (F  F^)* 
dxk  kxk 


(473) 
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W”  f 


The  Graa-Schmidt  deconqjosition  orthononnal  of  Equation  (409)  was  for  a 
full  rank  dxd  matrix.  If  we  partition  the  k row  vectors  of  dimension  d 
into  its  column  space  we  have 


<^fC0) 


fC^,  f(^  ...  f(^] 


(474) 


<^f(k) 

or  d linearly  indepdent  column  vectors  in  the  larger  k space.  If  we  now 
apply  the  Gram-Schmidt  proceedures  of  Equation  (308)  to  the  column  n-tuple 
vectors  of  Equation  (474)  we  obtain 


g(l^  = f(l> 

^1  ^ 1 

s(i^  * f(k> 
^1 


(475) 


(476) 


f(^ 


The  packaged  results  are 


iJ 


i.j 


or 


G =»  F B 

g 

kxd  kxd  dxd 


or 


kxd 


F 

kxd 


anu  for  the  orthonormal  vectors 


S B ■ F 
s 


Transposing  Equation  (481)  and  Equation  (482) 


_T  n -T„T  - -T  „T 

F * B G ■ G S 

g s 

dxk  dxd  dxk 


(479) 


(480) 


(481) 


(482) 


(483) 
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Forming  the  full  rank  "inner-Grairanian”  we  have 


Rewritting  Equation  (484) 


By  Equation  (484)  let  the  iqiper  triangular  matrix  B 


and  like-wise  for  the  unit  triangular  matrix  B 


Hence 


or  upper-triangular  factors  in  d space.  Inverting  Equation  (487) 


T - 1 T -IT 

(F  F)  -BB  =BD  B 
^ s s K fi  8 


-1  -T  T 

« U U =»  U.D  U, 

1 g 1 

Hence  by  resolving  Equation  (491)  into  its  triangular  factors  by  the 
Cholesky  algorithm  of  Equation  (463) 


(- 


= (g.  .)  = u'^’u 


of  that  equation,  one  can  solve  Equation  (471)  for  the  unknown  vector  a(d^ 


The  inverse  of  for  a 3x3  matrix  is  given  by  Bjerhammer  on  page  328 


as 


(• 


^1 

0 

*1 

0 

-1 

St 

1 

^11 

0 

0 

0 

.Ui2 

1 

0 

“l2 

^22 

'*11^22 

'^22 

’^23 

CO 

CO 

■JL  “l3  “12^3 

U,  1 

11  U11U22 

■“23 

1 

*^33 

“22^33 

“33 

If  we  consider  the  solution  of  Equation  (470)  using  Equation  (472) 

a(^=  (f'^F)"^f’^  x(^  ( 

and  the  triangular  factors  of  Equation  (493) 


a(d^-  (U"^U"'^)  f"^  x(^ 


( 


as  the  first  method,  tlien  two  other  methods  of  computation  will  be 
pointed  out. 


There  are  many  papers  on  variations  of  Cholesky,  square,  root.  Gram- 
Schmidt,  etc.,  with  numbers  of  computations  counts,  numerical  stability 
etc.  listed  in  the  bibliography. 


ALTERNATIVE.  ORTHOCaNAL  PROCESS  TO  THE  GRAJ1-SQIMIOT.  There  are  many 
variations  to  the  triangular- i'actorization  f^or  positive  definite  matrices 
for  example  see  Schmidt  (reference  79  ).  Bierman  (reference  85  ) 

and,  Kailath  (reference  42  ).  Staib  in  his  paper  presents  an  alternative 
which  he  says  if  it  is  not  original  that  it  is  not  widely  known.  He 
reduces  a positive  definite  matrix  to  triangular  form  by  row  operations 
and  states  that  row  multiplication  can  be  freely  used  to  avoid  fractions 
which  he  says  means  that  he  can  devise  computer  programs  that  will  not 
suffer  from  round-off  error.  Row  operations  will  not  be  used  in  tliis 
discussion  but  since  his  example  centered  around  the  4x4  Legendre 
metric  the  3x3  case  of  Equation  (366)  will  be  discussed 


/I 

-1 


(1.  t. 


t^)dt)= 


2 

0 


0 2/3 

2/3  0 


(505) 


2/3  0 2/5 


If  one  has  either  the  orthonormal  base  or  the  base  which  has  a 
unit  triangular  matrix,  a new  orthogonal  base  can  be  obtained  by  an 
arbitrary  diagonal  matrix  scaling  or 


and 


or 


<|a  ' '^a 

<Ci  =■ 

<(a“<!"a«g“<1« 


(506) 


(507) 


If  one  replaces  g^  by  and  Bg  by  B^  for  any  alternate  orthogonal  base. 


the  inverse  is  given  by  Equation  (403) 


-1  T 


-1 


and  the  inverse  of  the  Mff  matrix  is  given  by  Equation  C348) 


-1  -1  T 

n..  ^ o B U ' 
ff  a a a 


(509) 


The  transformation  which  Staib  uses  for  the  example  is  a triangular 
matrix  of  integers  obtained  from  Mff  by  row  operations  and  is  a matrix 
of  integers 


<|a  ■<! 


0 0 


0 0 0 


The  diagonal  metric  matrix  is 


D = B M-JJ 
g a ff^  a 


and  the  inverse  is 


0 0 


0 8/5  0 


0 8/7 


(510) 


(511) 


1/6  0 


(512) 


The  inverse  by  Equation  (508)  is 


(513) 


Alternative  Gram-Schmidt  (First  Coordinate  Unity) 


We  see  by  Eq  (303)  and  Eq  (308)  that  the  orthogonalization  procedure 
described  by  Eq  (308)  is  quite  standard  in  the  linear  vector  space  text 
books  and  generates  a unit  upper-triangular  matrix.  The  coordinate  of  the 
higest  su^^cript  designated  the  base  vector  is  taken  to  be  unity,  that  is 


for  the  k vector 


Si,  1 


(514) 


When  the  base  vectors  are  the  monomial  base  t we  see  that  the  poly- 
nomials are  monic  that  is  ( slipping  the  index) 


Sk  = ^o  ^ ^1^  ^ ^ 


(515) 


the  classical  orthogonal  polynomials  reals  correspond  to  the  alternate 
Gram-Schmidt  procedure  described  below.  The  3x3  case  will  be  applied  to 
(o.l)  interval  to  obtain  the  Legendre  polynomials  which  agree  with  those 
presented  by  Milne  ref.  ( 60 ) . 


Consider  now  the  sequence  (with  the  index  shifted  to  zero  to  conform 
with  the  polynomial  degree)  as 


<d)f  = 


(516) 


g = f 
^o  o 

and  by  Fig  (7)  for  the  second  vector 


(517) 


I 


Figure  (7)  Two  Dimensional  Case 


= *^1  ^1  ^ 


or 


gi  = n 


--<f  A(2>^ 


II 

Impose  the  constraint 


= 0 = » (f^.tp  A(2X 


or 


,,  f a f 

= _o O 


f a f, 

o 1 


also  for  the  third  vector 


= ^^o’^l’^2^''  ^ 


I X, 


L'2 


r^oi^  §2  = 


L^I 


roi  =rf  ia  ^(3>: 


L^l 


Define 


r f 1 

a (f  ,f, ,f^)  = 

rf 

f , 

f 

o 

o 1 2 

oo 

ol 

02 

f. 

f. 

f 

f J 

L 1-1 

L lo 

11 

12-' 

Hence 
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'l?ll^1l^lllSF^Sni^fl  ifliTlni  t ff'iiiiiif 


(518) 


(519) 


(520) 


(521) 


(522) 


(523) 


(524) 


(525) 


i! 


and  for  the  k vector 


or 


®k-l  ” ’ '^k-1^ 


k-1 


f~  — 

f 

0 

o 

« 

®gk-l  = 

0 

~ 

• 

• 

0 

k-2 

oo 


0(k 


ni(k-p'  , M 

(k-l)(k-l) 


h(k 


in(k^ 
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The  package  of^g  vectors  are 
'ill 


= <? 


11 


12 


1 

. A 


l,d-l 


22  • 


2,d-l 


d-l,d-lj 


(532) 


The  orthonomal  vectors  obtained  via  this  procedure  will  differ  in 
signs  from  the  procedure  o£  Eq  (305).  This  latter  statement  is  obvious 
from  the  direction  of  the  g vector.  These  two  Gram-Schmidt  procedures 
are  used  later  to  obtain  some  of  the  classical  orthogonal  polynomials. 


TRANSFORMATION  FROM  UNIT  UPPER  TRIANGULAR  TO  UNIT  UPPER  ROW. 


Consider  an  upper  triangular  matrix 


U 

OO 

%i 

^o2^ 

u = 

0 

'^11 

^2 

_ 0 

0 

^22- 

(533) 


where 


oo 


oo 


(534) 


%1 

^1 

u, , 

1 

11 

_0 

_0  _ 

^11 


(535) 
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where 


The  Classical  Continuous  Gram  Polynomials  Via  The  Alternate  G.  S. 
Process . 


The  4x4  case  of  the  Gram  ploynomials  on  the  (0.1)  interval  are 
derived  here  using  the  unit  first  row  upper  triangularization  procedure 
(G.S.).  The  monomial  basest  has  the  Hilbert  matrix  as  metric,  or 


( 


0 = (1,  1)  /I 


(547) 


hence 


Ai  - -2 


= (l.t)/  1 


The  third  vector  is 


g2  = (l,t,t^)/  1 


2/2 


and  by  Eq  (523) 


(548) 


(549) 


(550) 
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2 3 4 


(551) 


Clearly  Eq  (551)  requires  us  to  find  a vector  a(^  in  the  null-space 


H a(^  = 0(^ 

2x3 


(552) 


One  approach  is  to  compute  the  orthogonal  complement  projector  and 
its  rank-one  factor 

* 2 ^ 

P = I - H H = uC^  <3)u  (553) 

3x3  3(2)3 

since  P has  rank  one,  the  vector  factor  is  always  a solution.  However  we 
desire  the  first  coordinate  to  be  unity  (since  we  have  one  free  choice  - 
2 equations  and  3 unknowns).  The  easiest  approach  appears  to  be  via 
Eq  (527)  that  is 


r . 


f 


I 

I 


We  have  by  Milne  Ref  (eo  ) page  ( 259 ) 


a 

o 

1 

1 

H 

O 

(3+0) 

o 

^1 

(-1)^ 

(^;^) 

^2 

= 

(-1)^ 

(^;^) 

(-1)^ 

(3+3) 

^ 3 ' 

or  for  the  vector 


a 

(-1)° 

("•) 

>m+Ox 

o 

o 

o 

^1 

(-1)^ 

(™) 

^2 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

(-!)’" 

(") 

^m+k. 

^ k ^ 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

• 

a 

m 

(-1)"’ 

O 

m 

m 

m 

(566) 


(567) 


Clearly  the  Gram-Schmidt  process  would  be  quite  difficult  to  derive 
a general  term  such  as  given  by  Eq  (567).  Milne  in  ref  (60 ) has  a scalar 
method  for  such  a derivation.  The  G.S.  insight  is  worthy  of  note,  thus 
has  been  presented. 
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GENERALIZATIONS  OF  SOME  CONTINUOUS  METRICS  AND  ORTHOGWAL  POLYNOMIALS 
WITO  RESPECT*  Yd  PARiTCULaR  The  stsm(far(l  textbook  on  the  subject 

of  Orthogonal  Polynomials  is  Szego  (1939).  The  Erdelyi  reference  on  page 
153  states  that  with  an  interval  (tb,tf)  and  a weight  function  w(t)  which 
is  non-negative  there,  we  may  associate  the  scalar  product 


(fi.f^) 


'^f 

w(t)  f.(t)f.(t)dt 
"b 


(1) 


which  is  defined  for  all  functions  f(t)  for  which  w(t)^  f(t)  is  quadratically 
integrable  in  (tb,tf).  More  generally,  a scalar  product  may  be  defined  by 
a Stieltjes  integral 


(f. ,f.) 


f.(t)f.(t)do(t) 


(2) 


where  a(t)  is  a non-decreasing  function  called  a distribution  function.. 
If  a(t)  is  absolutely  continuous  Equation  (2)  reduces  to  Equation  (1) 
with  w(t)=o'(t).  On  the  other  hand  if  a(t)  is  a jump  function,  that  is 
constant  except  for  jumps  of  the  magnitude  wj^  at  t«tj^  then  Equation  (2) 
reduces  to  a sum 


(fi.fj)  - ^ ViCVfjCV  . C3) 

which  is  the  appropriate  definition  for  functions  of  a discrete  variable. 

The  reference  states  further  that  the  above  definitions  refer  to  real 
functims  of  a real  variable(the  case  restricted  to  throughout  most  of 
this  report) . 

It  was  shown  in  the  previous  section  Equation  (156)  that  the  weighted 
inner-product  or  inner-product  with  respect  to  a given  weight  function 
can  be  considered  as  a base  change. 

Certainly  when  one  defines  a norm  on  a vector,  and  then  an  inner- 
product  on  two  vectors,  nothing  of  interest  ensues  if  one  does  not  look 
at  the  inner-product  on  a sequence  of  base  vectors  for  the  full  space 
or  a subspace,  for  example  when  one  is  given  the  coordinates  of  the 
two  vectors  in  a base  we  have 


7^?Sr9!^Si’Sf!^^SSS37!^^ 


(X 


, y)  “ x@y  ■ <^  M ^ 


(4) 


where  the  matrix  M is  the  metric. 


The  classical  orthogonal  polynomials,  the  interval  and  the  weight 
function  are  given  by  Rice  on  page  36  in  the  following  table. 


CLASSICAL  ORTHOGONAL  POLYNOMIALS 


TABLE  (1)  RICE 


Davis  in  his  book  on  page  168  states  that  the  following  special 
selections  of  (th.tf)  and  w(t)  have  been  studied  extensively,  and  the 
resulting  orthonormal  polynomials  constitute  the  "classical"  orthogonal 
polynomials. 


SO^E  CLASSICAL  ORTHOGONAL  POLYNOMIALS 


INTERVAL 

WEIGHT  FUNCTION 

NAME 

(-1.  1) 

w(t)  “ 1 

LEGENDRE 

(-1.  1) 

w(t)  *=  (l-t2)-^ 

TSaiEBYSaiEFF  POLYNOMIALS 
(of  the  first  kind) 

(-1,  1) 

w(t)  - (1-t^)*^ 

TSCHEBYSaiEFF  POLYNOMIALS 
(of  the  second  kind) 

(-1.  1) 

w(t)  = (l-t)“(l+t)P 
0,6  > -1 

JACOBI  POLYNOMIALS 

(0,  oo) 

w(t)  = t‘^e"^ 
d > -1 

LAGUERRE  POLYNOMIALS 

(-  CO,  gj 

w(t)  = 

HERMITE  P0LYN0>JIALS 

TABLE  (2)  DAVIS 


!J!lEUajU 


INTERVAL 

WEIGHT  FUNCTION 

NAME 

(-1,  1) 

(-1.  1) 

w(t)  = 1 
w(t)  = (1-t)^-'^ 

LEGENDRE 

GEGENBAUER 

1 

(-1.  1) 

w(t)  = (l-t)“(l+t)S 

JACOBI 

i 

(-00,  oo) 

w(t)  = e”f“ 

HERMITE 

. J 

( 0,  oo) 

< 

II 

• 

GENERALIZED 

,1 

LAGUERRE 

- - 

■ 


> i 


J 
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Rice  states  that  the  Legendre  and  Gegenbauer  polynomials  are  special 
cases  of  the  Jacobi  polynomials.  He  states  further  that  the  classical 
orthogonal  polynomials  are  not  the  only  systems  of  polynomials  orthogonal 
on  the  interval  (0,1).  For  any  weight  function  w(t)  there  corresponds 
a system  of  orthogonal  polynomials  (obviously  one  can  always  do  a Gram- 
Schmidt  (procedure) . On  page  6 of  Rice  we  find  the  statement  that  the 
L_  - norms  may  be  generalized  by  the  introductim  of  a weight  function 
w\t) . He  states  that  while  we  may  conceivably  use  any  integrable  func- 
tion w(t)  •••we  normally  ccmsider  only  those  weight  functions  for  which 


w(t)dt 


w(t)  > 0 


0 < t < 1 


However  for  the  purpose  of  this  report  and  in  the  derivations  of  ex- 
ponentially weighted  least-squares  filters  via  Laguerre  polynomials  the 
weight  function  is 


w(t)dt  = 


^-at,.  1 

e dt  = — 
a 


Hildebrand  on  page  282  states  that  the  weighting  function 

w(t)  - (i-t)“(in)^  (7] 

a > -1,  6 > -1 

over  (-1,  1)  reduces  to  the  Legendre  case  when  a = B = 0 and  to  the 
Chebyshev  case  when  a » B ® . Note  that  Tschebyscheff  and  Chebyshev 

refer  to  the  same  person.  2 

Hildebrand  on  page  282  is  a little  more  general  in  what  he  calls  the 
generalized  Laguerre  Polynomials  (also  he  says  frequently  called  the  Scmine 
polynomials)  and  uses  the  weight 


w(t)  ■ t^e”*^(d>  -1,  a>  0) 


1 


Rainville  on  page  213  refers  to  the  simple  Laguerre  polynomials,  which 
correspond  to  d»0  and  a»l  in  Equation  (8)*'otHrneDran3sweigKTr’“"“ 

There  has  been  extensive  applications  of  Laguerre  polynomials  to  linear 
and  non-linear  systems  analysis,  both  in  the  time  and  frequency  domain. 
Morrison  in  his  paper  "Smoothing  and  Extrapolation  of  Continuous  Time  Series 
Using  Laguerre  Polynomials"  defines  the  norm 


|lfl|.(  f2(t)e-®^dt 


and  the  inner  product  of  two  functions  f(t)  and  g(t)  as 


(f.g) 


f(t)g(t)o"a«dt 


The  weight  of  Equation  (10)  is  the  one  primarly  used  in  this  paper 
and  its  discrete  analog  in  a later  section. 

The  standard  approach  to  the  various  types  of  polynomials  is  via  the 
route  of  generating  functions,  a very  tedious  area  of  mathematics;  however, 
they  will  not  be  discussed  in  this  report. 

Before  proceeding  to  a simple  derivation  via  Gram-Schmidt  of  the 
Laguerre  polynomials,  some  terminology,  jargon,  and  concepts  associated 
with  classical  approximation  theory  and  modem  vector-space  theory  will 
be  discussed.  Even  though  Davis'  book  is  quite  vector  space  oriented, 
for  the  state-space  orientation  of  this  paper  some  of  the  terminology 
will  be  aliased  in  parenthesis.  On  page  169  Davis  presents  a definition: 

re FI NX TI ON : Let  S2,S2,  be  a finite  or  infinite  sequence  of 
orthonormal  elements  (the  orthonormal  condition  implies  linear  indep- 
endence and  for  clarification  and  applications  herein  the  elements  are 
to  be  token  from  a vector  space  and  form  a base  for  the  space  or  a sub- 
space) . Let  x(t)  be  an  arbitrary  element  (vector).  The  series 


I , 

n“l 


is  the  Fourier  Series  for  x(t).  (Tl^ representation  of  the  vector  x(t) 
in  the  particular  orthonormal  base  ^).  If  the  sequence  is  finite  we 
use  a finite  sum.  Tlie  constants  (x,Sn)  are  known  as  the  Fourier  Co- 
efficients  of  x(t)  (the  constants  (x,Sn)  are  the  coordinates  of  the 
vector  x(tj  in  the  orthonormal  base  ^'s) . One  frequently  writes 


x(t)  - I (x,Sj^)s  (11) 

n=l 

to  indicate  that  the  right-hand  sum  is  associated  in  a formal  way' with 
the  left-hand  side.  (The  vector  x(t)  can  always  be  written  as 

00 

X(t)  » I 

n=l  ^ 

where  the  residual  or  error  vector  is  Xj.(t)).  The  relation  between  an 
element  and  its  Fourier  Series  has  been  the  object  of  vast  investigation 
and  theories. 

Davis  states  further  that  we  may  write 


X 


an 

(t)  - I 


n=0 


(Projection  of  x on  s^) 


and  hence  the  Fourier  series  of  an  element  (vector)  is  merely  the  sum  of  the 
projections  of  the  element  on  a system  of  orthonormal  elements  (base  vectors). 
On  page  162  Davis  presents  the  equation  proj ection  of 


Xj^  on  X2  = 


(Xj,X2  ) 


(13) 


which  he  states  serves  to  define  projection  in  the  abstract  case.  (See 
previous  section  for  concrete  projections  with  polynomials  over  the 
continuous  reals) . 


B.  CONTINUOUS  LAGUERRE  POLYNOMIALS.  Two  types  of  Laguerre  polynomials 
will  be  used  in  this  report  correspemding  to  the  weight  of  Equation  (6) 
namely 


w(t)  = e“*^ 


(14) 


in 


■AA  ■■■  J g^- V-  ^ .'f 


PJSy-ii  ;'^»,'-»v^''— ■.  ‘ 


and  for  a»l 

w(t)  = e"'"  . (15) 

Not  OTily  the  Laguerre  polynomials  with  respect  to  the  two  weights  above 
but  also  two  modified  Laguerre  polynomial  bases  will  be  derived.  The 
Modified  Laguerre  set  will  be  derived  via  a Grahm-Schmidt  procedure 
on  the  base 


e 


These  are  in  analogy  to  the  Modified  Legendre  discussed  and  derived  in  a 
later  section  and  related  to  the  Classical  Cegendre  Polynomials. 


The  base  change  approach  will  be  used  for  all  orthogonal  polynwnials 
starting  with  the  monomial  base  and  in  later  sections  their  velocities 
etc.,  will  be  derived.  The  previous  section  derived  the  3x3  Gram  and 
Modified  Legendre  polynomials  on  the  intervals  (0,1)  and  (-1,1).  If 
we  look  at  the  weights  for  the  Modified  Legendre  case,  we  see  it  is 
equal  to  one.  If  we  look  at  the  inner-product  interval  for  the  Modified 
Laguerre  case  we  see  (0^)  and  this  span  for  the  monomial  base  infinite 
entries  in  the  metric  matrix  without  the 


weight. 

We  designate  the  mcmomial  base 


(t^t^t^t^ 


that  is  the  subscript  on  the  first  base  element  of  the  sequence  will 
correspond  to  the  power  of  t,  and 


(16) 


i i '•  r 1 

t t-'  I = ! i,j  element  | 

J L j 


1. 


d-l  . 


(17) 


i.j  = 0* 


• • • 


If  we  want  the  first  base  clement  subscript  1,  etc.,  as  before 


^^1*^2* ^3* 


and  we  want 


<^f.< 


then 


i»j  = 1»  2,  •••  d 


and  the  indefinite  integral  is 


( . , f 

t^’^t^’^dt  » 


ti*j-2dt 


iTFT- 


( 


i,  j ® 1,  2,  3, 


IS 


Md  the  i^*  row  and  column  of  the  entry  of  the  metric  for  this  indexing 

^i+j-1 


oK= 


TijTi 


(; 


Retuining  to  the  indexing  of  Equation  (16)  where  the  index  runs 

i = 0,  1,  2,  3,  ...  d-1 


■•••«  • ix 


as  compared  with  Equation  (23). 

If  we  make  a time-varying  base  change  on 

-a  ^ 

<^D(t)  »<^  I e ^ “*^e 
Then  the  metric-matrix  for  the  this  new  base  is 


t>Ct  e dt 


the  i-j^"  element  of  the  integral  matrix  is 


and  by  Pierces  Handbook  of  Integrals  on  page  63 


e-“t  dt . iiaii 


applying  Equation  (27)  to  the  metric  matrix  of  Equatim  (26) 


dt  . flii!:)!,!  -[g., 

L'^J' 


or  in  open- form 


i, 


£L 

a 

a2 

2! 

a3 

3! 

a^ 

• • • 

(±})i 

1! 

21 

3! 

4! 

2 

“T 

■7 

T 

• • a 

• 

a 

a 

a 

a 

21 

3! 

4! 

5J 

“T 

“T 

T 

• 

a 

a 

a 

a 

3! 

4! 

5! 

• 

T 

a 

T 

a 

T 

a 

(d-DI 
“U — 

a 


(2(d-l))! 

-7^ 


(29) 


We  now  have  the  inner-product  of  the  base  elements  and  will  run  a Hram- 
Schmidt  proceedure  on  the  first  four  elements 

<f,  - <^t,  - ((.  t.  t’)  e-»t  . 

We  have  as  before  (index  starting  at  1,  2,  •••) 

Sel"  'el*  ^.2-  ^e3>  ^4> 


and  the  orthcxiormal  vector  is 
g. 


(30) 


(31) 


*ei  “ 


2L 


(32) 


lg: 


ei' 
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I 


T 


’I 


Proceeding  through  the  process  one  d>tains  for  the  first  four 

2 


<4)8,  . <^)f. 


a 


0 

0 


0 

0 


4 

"a 


1 

0 


3! 

"7 


18 

T 

a 

a 


or 


<4)g„  . <4)f  B 


^ e ge 
4x4 


The  first  3 orthonormal  vectors  are  from  the  computations 


<^3)%  “ <3)fe 


1 

0 

0 


-1 

a 

0 


-2a 

2 

a 

T 


(40) 


(41) 


(42) 


If  we  shift  our  index  back  to  zero  that  is  index  starting  at  (0»  1,  2, 

f ■»  /■-O  *1  -2  *d-l»  B 

- (gQ.  gj.  g2»  •••  gd-1^  “ (t  . t ,t  . t )gBg^ 


. d-1) 
(43) 


and 


(t°.  t\ 


■*  t 

.d-K  ^ 7 ^ 

• • • t ) e 


By  Equation  (25)  in  Equation  (43) 


<Cg 


-a 


e 

ge 
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. 1 Jet ti  ■ 


(44) 


(45) 


The  Modified  Laguerre  Equations  are  defined  by  Equation  (45)  and 


Equation 


Expressing  the  sunmation  of  Equation  (48)  as  inner-products  of  row  and  column 
vectors  we  have 


:J 


Packaging  the  previous  equations  as  a row  of  base  vectors 


and  the  matrix  of  modified  binomial  coefficients  by  Equation  (90  ) in 
Appendix  A is  the  Rutishauser  matrix 


R = 


(-1) 


“0 


-1)^^  1 

C) 

(-1)°  ' 

(:)••■ 

(-1)“ 

(V) 

-1)'  1 

C) 

(-1)^ 

C)--- 

(-1)^ 

(?) 

(-1)^  1 

0 

• 

(-1) 


-c: 


hence  Equation  (50)  can  be  written  in  factored  form 


which  is  the  matrix  representation  of  the  Classical  Lagucrre  Polynomials 

and  are  orthogonal  on  (0,*»)  with  respect  to  the  weight  e"®^  or  by  the 
base  change 


D(a")  f ^ R If  e 


-at 

7- 


■H 

<^t  Te^ 


(53) 


(54) 


(55) 

(56) 


we  have  the  Laguerre  functions  of  Equatim  (48)  which  Gillis  and  Bolgiano 
(for  a»l)  in  separate  papers  refer  to  as  forming  an  orthogonal  set  complete 
in  l2(0,"*). 


4 


h 

*■! 

ti 


K r 


B 

I 


If  we  foxm  the  metric  of  Equation  (56)  as 


l><lf 


dt  « M 


ttf  * 


(57) 


and  use  the  Ilf  subscript,no  ambiguity  can  occur.  Using  Equation  (56) 
in  Equation  (59) 


M ■ T 
Ilf 


t>  <t  e-»t 


C58) 


or 


* T M T 
Ilf  tte 

The  vectors  of  Equation  (56)  (not  normalized)  and  their  magnitudes  (thus 
the  metric  matrix)  is  a diagonal  matrix  whose  entries  are  the  squares  of 
the  norms,  that  is 


(59) 


Ilf 


^00' 


h"] 


(60) 


®d-ll 


The  squares  of  the  magnitudes  of  the  Laguerre  polynomials  are  given  by 
Hildebrand  page  276  as 


®nn 


.-at  ,80. 


(61) 


where  g,j,|  are  the  elements  of  the  metric  matrix  Equation  (60)  and  where 
l^(t)  is  given  by  Equation  (48),  hence 


123 


(0!)^ 


(1!)^ 


(d-1): 


The  normalizing  matrix  to  obtain  the  unit  magnitude  vectors  ^ is  the 
inverse  square  root  of  Equation  (62)  and  (64)  or 


" M.. 

X Uf 


and  by  Equatim  (62) 


® 'I  ttf 

hence  using  Equation  (64)  in  Equation  (63)  and  Equation  (54) 


or  the  Classical  Orthonormal  Laguerre  polynomials  are  given  by 


<1^  = <^t  D(a") 


The  individual  elements  are  given  by  Equation  (66)  and  Equation  (48)  as 

I • 

^ - yr  V (^t)  ff 


which  is  the  n^  orthonormal  Laguerre  polynomial  for  n-0,  1,  2 •••  d-1 
and  the  metric  is 


aXjI  e'^tdt  » I 
0 '^\x  ^ 


If  we  now  ccHnpare  the  Classical  Laguerre  polynomials  with  the  modified 
Laguerre  polynomials  for  the  f^irst  four  of  Equation  (50)  and  Equation  (40) 
respectively  we  have 


ci-c; 

1 

0 

1 

-a 

2 

-4a 

6 

-18a 

0 

0 

a2 

9a^ 

r 

o 

0 

0 

-aS 

and  for  the  modifieds 

II 

3 

II 

1 

“1/a 

2/ 

a2 

-6/a3 

0 

1 

-Va 

18/a2 

0 

0 

1 

-9/a 

0 

0 

0 

1 

(69; 


(7o: 


Clearly  the  two  matrices  differ  by  signs  and  a and  a~^  powers.  Notice  also 
that  tije  Classical  Laguerre  PolynCTiiials  do  not  have  unity  entries  on  the 
main  diagonal,  hence  arc  not  in  the  iconic  polynomial  form  as  are  the  modified 
Laguerre  polynomials  derived  via  Gram-Schmidt.  The nonic  constraint  <»i 
functions  given  by  say 


<b  » <^  U 

where  U is  upper  triangular  we  have 


(7i; 
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packaging  Equatim  (72) 


<S,  ■ <^  / "ii 
\ 


Hence  applying  Equation  (73)  to  the  elements  of  Equation  (69)  and  Equation 
(70) 


Using  Equation  (S3)  in  Equation  ( 77)  of  Appendix  A 

U-1)  D"^(a") 

Using  Equation  (S4)  in  Equation  (82) 

D(a")  f ^ R [f  K-l)  D‘^a") 
Using  the  commutitive  property  of  diagonal  matrices 
<<  = <<  U(a")  R I(-l)  If  D’^a") 


The  alternating  sign  binomial  matrix  of  Equation  ( 77  ) Appendix  A is 


R I(-l)  = B(-l) 


hence  using  Equation  (85)  in  Equaticxi  (84) 


1 

\<i^  = <^D(a")  B(-l)  If  D"^a") 


For  the  special  case  a=l,  the  first  six  Laguerre  polynomials  by  Equation  (60) 
are  the  same  as  those  given  by  Hildebrand  on  page  275  of  reference  (37  ) 
for  the  non-orthonormal  case 


or  factoring  out  the  a power  terns 


1/, 


dxd 


/a3 


Va2d-1 


0! 


1! 


2! 


j! 


(d-l)J 


Define  the  inverse  odd  powers  of  a matrix  as 


132 


r^^.dlir.sdZusj»43SJu , iL'l 1. 1 „ 


The  first  four  Modified  Laguerre  polynomials  are  given  by  Equation  (70) 


By  Equation  (66)  in  Equation  (114) 


<^  - <t  D(a")  R K-l)  /I 
and  by  Equation  (77  ) in  /^pendix  A 

The  orthonoimal  modified  Laguerre  functions  are 

Cju-f  • <“0  ^ 

• “s 

The  matrix  Bg  is 

. D(a")  B(-l)  ^ 

and  the  inverse  is  easily  obtained 

» B D‘^(a") 

/a 

and  for  the  3x3  case  of  Equation  (42)  the  inverse  is 


B-1  - ± 


IV  2:v 


l/a2  4/^3 


(115) 


(116) 


(117) 


(118) 


(119) 


(120) 


(121) 


By  Equation  (359)  of  the  previous  section  we  could  also  compute  the  inverse 
connection  matrix  as 


B 


T 

s 


C 


The  inverse  of  the  metric-matrix  can  be  obtained  via  Equation  (348  ) of 

section  ( 1 ) for  the  3x3  case  of  Equation  (29)  is 


'/a 

2-/a3 

-1 

3 

-3a 

2, 
a /2 

l/o2 

211 J 

3!/  4 

a 

-3a 

5a2 

3 

-a 

a 

a 

a 

_2!/a.3 

3!/^4 

4:/a5^ 

3 

-a 

1 

obtained  from 


-1  T 

^ = B B* 

tt„  s s 
e 


where  the  general  term  is  given  by  Equation  (119). 

In  conclusion  for  the  Laguerre  and  Modified  Laguerre  polynomials 
we  have  by  Equation  (54)  and  Equation  (tJ3) 


= <t  D(a")  R fl 
<1^  . D(a")  ff  ^ B(-l)  it  D'^(a") 


and  for  the  Laguerre  functions  and  Modified  Laguerre 
Equation  (55)  and  Equation  l4^) 


<^f  " <^e  ^ 

<^m^  -<^0  ^ D‘^(a") 


( 

( 


fimctions  by 
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For  the  ortliononnal  La^uerre  polynomials  and  modified  polynomials  by  1 

Equation  (66)  and  Equation  ( 109) 

D(a")  R /a  (129) 

D(a")  B(-l)  /a  (130)  I 

with  the  correspcmding  change  to  the  e subscript  on 
and  Equation  (130)  for  the  orthonormal  functims. 

The  inverse  transformations  are  easily  obtained  since  by  Appendix  A 
the  Rutishauser  matrix  R is  its  own  inverse  that  is 

=•  R (131) 

and 

B(-l)"^  = B . (132) 


C.  CONTINUOUS  POISSON  POLYNOMIALS.  Morrison  states  in  reference  (ei  ) 
that  the  Laguerre  polynomials  give  rise,  in  a very  natural  way,  to  a real* 
true  spectrum,  analyzer.  He  says  that  another  virtue  of  the  Laguerre 
polynomials  is  that  their  Laplace  transforms  are  given  by  very  simple 
formulas. 

Bolgiano  in  his  paper  "Relationship  of  Poisson  Transform  to  Laguerre 
Expansions"  referrace,  states  that  •••  one  obtains  the  Laguerre  function 
used  by  Steiglitz  in  his  paper  " The  Equivalence  of  Digital  and  Analog 
Signal  Processing"  reference  (84  ) to  represent  positive  time  signals 
for  the  digital  simulation  of  analog  signal  processing.  He  says  Steiglitz 's 
representation  offers  the  convenience  of  an  orthogonal  representation  for 
signals.  However,  for  systems  it  does  not  offer  as  direct  a representaticm 
as  the  Poisson  transform,  which  •••  permits  obtaining  the  unit  pulse  re- 
sponse for  a discrete  system  from  the  unit  impulse  respoise  of  the  analog 
system  it  simulates  in  the  same  manner  as  discrete-time  signals  are 
derived  from  analog  signals.  From  the  above  statements  of  the  two  authors 
it  is  felt  that  the  frequency  domain  study  of  digital  and  analog  (discrete 
and  continuous)  filters  can  be  enhanced  by  knowledge  of  both  types  of 
polynomials. 


If  we  attempt  to  apply  some  state-space  techniques  to  the  results  of 
Bolgianos  paper  where  he  treats  the  Laguerre  orthonormal  polynomials  for 
a«l  by  Equation  (129) 

<t  R • <ju 

Define  the  Poisson  polynomials  by 


C^Ct)  » If"^ 

and  like-wise  the  Poisson  Functions  by 


Using  Equation  (134)  in  Equation  (133) 


(134) 


(135) 


-t/2 

and  multiplying  Equation  (136)  by  e 

'^‘uf  ■ <^f  " 

The  inverse  base  change  is  now  very  simple,  by  Equation  (131)  in 
Equation  (137) 

<;f  ■ <iut " 

The  metric  matrix  for  the  Poisson  Functions  is 


0 


P(t)^  <P  dt  ■ 

f\ 


m 

0 


(136) 


(137) 


(138) 


R 


(139) 


r 


M = R R 
PP 


The  5x5  case  yields  Equation  (95)  Appendix  A 


T 

R R = 


(140) 


1 

1 

1 

1 

2 

3 

4 

5 

3 

6 

10 

15 

4 

10 

20 

35 

5 

15 

35 

60 

(141) 


Thus  we  see  that  the  Poisson  polynranials  are  "oblique”  that  is  "non- 
orthogonal". 

If  one  has  a finite  vector  function  f(t)  given  by 

««  -<^uf  ^ 

and  makes  a base  change  given  by  Equation  (36) 
f(t)  = R 


(142) 


(143) 

(144) 


we  see  that  the  connection  between  the  coordinates  is 


R a^ 

and  by  Equation  (131) 

R a^ 


(145) 


(146) 


I 


Thus  Bolgiano  states  that  the  elements  of  these  two  sequences  have  been  shorn 
by  Bedard  to  be  related  to  each  other  by  the  symmetrical  equations 


(;)  ^ 


(147) 


‘V  -L'-"'  (5) 


(148) 


which  is  an  obvious  deduction  from  Equation  (145)  and  Hquatioi  (146).  No 
further  applications  in  this  section  are  planned  for  the  Poisson  functions. 

Another  earlier  paper  in  1955  by  Ule  "Weighted  Least-Squares  Smoothing 
Filters"  applies  Laguerre  polynomials.  In  an  earlier  paper  1954  W.  Kautz 
"Transient  Synthesis  in  The  Time  Domain"  applies  Laguerre  polynomials. 
Indeed  one  can  apply  these  polynomials  with  Kalman  filters,  where  one 
for  example,  assures  accelerations  constant  over  a span,  hence  implying 
second  degree  polynomials.  If  we  form  the  dyadic  product  of  the  Poisson 
Polynomials  given  by  Equation  (136)  we  have 


p(^<^(t)  = 


(149) 


Clearly  we  could  evaluate  this  inatrix  on  the  interval  (0,1) ,(-1,1) ,(tb,tf) 
etc  , and  obtain  finite  elements, 

D.  CONTINUOUS  EXPONENTIAL  POLYNOMIALS.  Exponential  fitting  functions  are 
of  interest  to  systems  engineers,  economists,  statisticis,  numerical  analysis 
or  wherever  polynomials  of  the  form  can  be  used 


where 
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(fo*^l»^2‘ 


^d-P 


(e 


-Aot  -Xjt 


e-Xd-lt) 


(154 


Using  the  integration  formula 


e clt  . ^ 


(155) 


Ftod  the  dyadic  product  of  Equation  (154)  for  the  3x3  case  and  integral 
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e"^0^ 


e-V 


(e'^O^^  e"^2t)dt 


e-(Ao-Xi)t 


0 e-^'l*V^  e-2^1^ 
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Using  Equation  (155)  in  Equation  (157) 


^y><l  dt  = — — i 

^ 2Xq  ^0'*’^1 


For  the  special  case 


Ai+Xq  2Xj 


^2*^0  ^1*^2 


j-(Ao-*-^2^^ 


-2X,t 
e 2 


Xq+X2 


Xi+Xz 


(156) 


(157) 


(158) 


Xn  - (n+l)XQ 


(159) 


IVendroff  on  page  1 


a Hilbert  matrix  of  order  n and  says  it  is  ill-c(xiditioncd  also. 


We  find  Fox  in  his  book  ot  page  75  gives  the  inverse  of  the  4x4  case 
of  Equation  (163)  as 
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exactly.  Paul  Brock  uses  exponential  polynomials  in  his  paper  "A  Relation 
Between  Exponential  and  Polynomial  Methods  For  the  Numerical  Solution  of 
Ordinary  Differential  Equations"  reference  (15  ). 

E.  CONTINUOUS  ORAM-POLYNOiMIALS.  The  Cram-Schmidt  proceedure  for  the 
interval  (!o.l)  was  derived  in  the  previous  section.  Tlie  general  Hilbert 
matrix  is 


(166) 


for 


0 £ i , 

j < 

d-1 

form 
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dxd 
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(167) 


Tlie  Hr  an- Schmidt  proceedure  applied  to  the  monomial  base  on  the  interval 
(0,1)  is  given  by  Equation  (337)  of  Section  ( 1 ) for  the  3x3  case  as 


= ^ r 
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r^s  . ^^t 
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case 

by  Equation  (338)  Section  ( 1 ) as 
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/5  1 
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0 

0 
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The  polynomials  of  Lquation  (168)  will  be  designated  as  the  ModiJ^ed 
Gram  Polynomials  as  in  the  Laguerre  case  because  of  the  sign  differences 
and  diagonal  terms  to  be  discussed  next. 

Milne  in  his  book  reference  ( 60  ) on  page  257  gives  the  general 
term  for  what  I will  call  the  Classical  Gram  Polynomials,  the  n^^  element 


(170) 


n = 0,  1,  2,  3,  •••  d-1 


By  Equation  (170)  we  have 


= / 1 


- ,,n  / o\  \ 

[qJ  \ 
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and  for  the  d vector  n ■ d-1 
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/d-i^ 

(a-:/ 

The  first  nine  Gram  polynomials  are  given  by  Milne  reference  (60  ) on 
page  260  as 
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If  we  compare  the  first  three  of  these  we  see  as  before  that  the  signs 
differ  as  well  as  the  main  diagonals  of  the  Classical  Gram  polynomials  are  not 
unity.  Normalizing  these  diagonal  elements  by  Equation  (73)  we  obtain 


<e-<t 


1 1 1 


0-2-61  0 -1/2 


(177) 


1 .1/2  1/, 


1 -1 


(178) 


0 0 


which  is  an  agreement  witli  Equation  (168)  for  the  modified  Gram  polynomials 
obtained  via  the  Gram-Schmidt  proceedure. 

The  metric-matrix  for  the  classical  Gram  polynomials  is  given  by  Milne 
on  page  261  of  reference  ( 60  ) as 


«,^(t)dt 

n 


(179) 


n = 0,  1,  2,  •••  d-1 


and  for  the  dxd  case 


or  element  wise 


r 1 

M = 

n 

The  metric-matrix  of  Equation  (180)  v/ill  be  referred  to  as  the  Gram- 
polynomial  metric-matrix.  T)ie  orthononr.al  vectors  are  obtained  by 


a M 


or 


= 


1. 

“'■2 


Zi 


/I 


which  are  the  Classical  orthonormal  Gram  polynomials. 


By  Equation  (172)  normalizing  the  seccmd  coordinate 
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1 » I,  a 
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the  n term  by  Equation  (174)  is 


I a t 

n nn 


2n  U-D' 


and  the  d^  vector  is 


The  connection  matrix  is 


'(d-l)m 


(IBS) 


(186) 


(187) 


(188) 


,<*11. » 


The  metric-matrix  of  tlie  modified  Cram  polynomial  is  by  Equation  (188) 


\ 


Tn 


'**  ■ U-l) 


(192) 


and  by  Equation  (181)  and  (187) 

m 

for 

n = 0,  1,  2, 
a diagonal  matrix. 


/2n\ 

1 

/2n( 

2n+l 
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(193) 


Using  Equation  (191)  in  the  inner  matrix  product  of  Equation  (193)  all 
diagonal  matrices 
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(194) 


and  the  metric  matrix  for  tlie  modified  dram  polynomials  is 


11 


- dig 


(2n:)^  : 


(2n*l)  (n:)4 


(195) 


since  I(-l)  enters  as  a square  with  respect  to  diagonal  matrices  in  Equation 
(193). 

One  can  now  obtain  the  inverse  of  the  Hilbert  matrix  by  Equation  (348  ) 
of  section  (1) 


(0,1) 


-1  T 

H.  = B B 
Ha  s s 


(196) 
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where  the  matrix  B5  connects  the  orthonormal  Gram  polynomials  to  the  monomial 
base,  that  is 


<5u-<* 
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t M 


-1/2 


tl 


(197) 


•1/2 


where  is  given  by  Equation  (176)  " is  obtained  via  Equation  (181). 

The  details  will  not  be  carried  through  here. 


D.  CONTINUIOUS  LEGENDRE  POLYNOMIALS.  The  continuious  modified  Legendre 
polynomials  on  the  interval  (-1,  1)  were  obtained  via  a Gram-Schmidt  process 
for  the  3x3  case  in  the  previous  section  ( 1 ) Equation  (383  ).  This 
section  presents  some  relations  for  the  general  case  on  the  interval  (-1,1), 
and  a latter  section  derives  the  state-space  relations  for  an  arbitrary 
interval  and  a re-scaled  time  axis. 


The  general  metric  for  (-1,1)  is 


f dt 


f^cf dt 
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^P<f^dt 


(198) 


-1 


and 


For  the  monomial  base 
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we  have 
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(199) 
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Using  Equation  (202)  and  Equation  (167)  in  Equation  (198) 


The  3x3  modified  Legendre  polynomial  case  is  given  in  the  previous  section 
by  Equation  (384) . Applying  the  Gram-Schmidt  formula  of  Equation  (308)  of 
that  same  section,  one  finds 


rn 

f 

1 Ti 

One  can  continue 

^ i 
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s 

polynoaials  are  g 
is  due  to  Barker) 

i 

V 


Note  the  alternation  of  zeros  in  the  coordinates  and  the  corresponding 
alternation  of  zeros  in  the  netric  on  the  interval  of  Equation  (203).  The 
first  three  modified  Legendre  polynomials  are  given  by  Davis  on  page  (168) 
of  reference  and  agree  with  those  derived  here  via  the  Gram-Schmidt  approach. 
Davis  calls  them  Legendre  polynomials  even  though  he  uses  the  Gram-Schmidt 
proceedure  as  done  in  this  report. 

The  metric  for  the  first  four  vectors  of  Equation  (20S)  is 


(206) 


The  first  three  orthonormal  Modified  Legendre  polynomials  are  given  by 
Equation  (334)  of  section  ( 1 ) as 


(207) 


Erdelyi  on  page  180  of  reference  ( 29  ) and  Rice  on  page  (68)  of  reference 
both  given  the  following  general  formula  for  the  nth  Legendre  polynomial. 
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(208) 


0,  1.  2, 


d-1 


where  ^ yj  ■eans  the  greatest  integer  less  than  or  equal  to  y depending 


on  whether  n is  odd  or  even. 


If  we  evaluate  the  formula  given  by  Equation  (208)  for  the  first  seven 
polynomials  we  obtain  the  first  seven  "Classical”  Legendre  polynomials. 


I 


We  see  that  the  main  diagonal  terms  are  not  unity,  hence  the  polynomials  are 
not  the  result  of  a Gram>Schmidt  as  applied  in  the  previous  section.  Rainville 
on  page  (160)  of  reference  gives  exactly  the  polynomials  of  Equation  (208). 

Also  Hildebrand  on  page  273  of  reference  gives  the  first  six  polynomials  which 
agree  precisely  with  the  first  six  of  Equation  (209). 

Hildebrand  on  page  273  describes  the  n^^  Legendre  polynomial  in  the 
usual  way  as 


i„(t)  . 


(t^-1)" 


(210) 


which  is  the  Rodrigues*  formula. 

Luenberger  on  page  61  of  reference  ( 54  ) relates  the  polynomials  applied 
on  the  (-1,1)  interval  via  the  Gram-Schmidt  orthonormal  proceedure  to  the  well 
known  Legendre  polynomials  satisfying  Equation  (210)  and  Equation  (208)  as 


r/2n*l 


t„(t) 


for 


(211) 


n « 0,  1 , 2,  • • ' d-1 


and  package-wise  we  have 


162 


which  connects  the  Classical  orthogonal  to  the  orthonormal  polynomials. 


Luenberger  on  page  61  of  reference  ( 54  ) states  that  the  polynomials 
obtained  on  the  (-1,1)  interval  via  the  orthonormal  proceedure  are  related 
to  the  well  known  Legendre  polynomials  satisfying  Equation  (210)  via 


(V  * 

n 2 

Luenberger  is  correct  in  his  statement  for  this  case  since  we  see  by 
Equation  (209)  the  main-diagonal  non-unity  numbers  are  all  positive,  hence 
the  alternating  signs  which  occurred  in  the  Lag  lerre  and  Gram  polynomials 
are  not  present  for  the  Legendre  polynomials. 


163 


Clearly  the  normalizing  matrix  to  obtain  the  orthonormal  Classical 
Legendre  polynomials  is 


<t„(t)  . <l(t)  ^ .<«  di 


dig 


2n+l 


-1/. 


(216) 


or 


I (t) 
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dig 


2n+l 
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(217) 


which  are  the  elements  of  liquation  (211). 

The  connection  between  the  Classical  (non-orthogonal)  polynomials  of 
liquation  (209)  and  the  modified  Legendre  polynomials  of  Equation  (205) 
derived  via  the  Gram-Schmidt  proceedure  of  this  report  can  be  obtained. 

By  Equation  (73)  we  have  for  the  4x4  case 
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or 
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where  dig  ( ) designates  the  diagonal  matrix  of  Equation  (221). 

Ne  can  now  obtain  the  metric-matrix  for  the  modified  Legendre  polynomials 
via  Equation  (222) 


X 1 

A ><^  dt  = dig  ( ) 2"  M *^^8  ( 2"  I (223) 

-'"^m  L j L- 

-1 


or  by  Equation  (215) 


With  the  transformations  derived  above  one  can  relate  Legendre  polynomials 
to  the  Laguerrc  polynomials  etc. 


Section  3 


TRANSLATION  OF  ORIGIN  AND  SCALING  ON  THE  TIME  AXIS  AND  INDUCED  TRANS- 
FORMATION METRIC  MATRICES  GRAM-SCHMIDT  VECTOR.  The  continuous  metric 
matrices  and  the  Gram-Schmidt  obtained  orthogonal  polynomials  of  the  pre- 
vious section  were  all  with  respect  to  inner-products  on  classical  in- 
tervals. This  section  will  extend  the  classical  intervals  (0,1)  (-1,1), 
(0,t2)etc.,  to  arbitrary  intervals  on  the  independent  variable  axis  (time) 
and  derive  a number  of  the  corresponding  polynomials  orthogonal  on  the 
arbitrary  continuous  intervals  which  actually  occur  in  optimal  estimation 
and  approximation  theory  in  practice.  The  necessary  induced  transforma- 
tions for  the  monomial  base  metrics  on  these  arbitrary  intervals  and  the 
corresponding  orthogonal  polynomials  with  respect  to  the  arbitrary  metrics 
will  be  defined  in  terms  of  new  upper  triangular  connection  matrices  for 
Gram,  Legendre,  and  Laguerre  polynomials  over  thse  intervals. 

Monomial  Base  Metric  Matrix  for  Arbitrary  Intervals.  For  the  pur- 
poses of  this  section  we  will  assume  that  the  classical  time  axis  vari- 
able is  T that  ranges  over  the  classical  intervals  and  we  have  a linear 
relation 


T = b^  + t = (1) 

where  bg  is  the  translation  to  the  new  origin  and  bi  is  the  scale  - fact- 
or. 


Consider  the  metric  matrix 
t)><t  dt  = 

Case  I - Transformation  Metric  (0,1)  -*•  (0,t2)-  The  first  case  con- 
sidered is  the  interval 

= (0,1)  (3) 

for  which  the  metric  is  the  standard,  Hilbert  matrix  given  by  Equation 


1 

* 

dt  = M(0,1)  = (4) 

■'o 

and  we  want  the  metric  for  the  inner  product  defined  on  the  variable  t 
for  the  arbitrary  interval 


By  Equation  (1) 

= 0 = (1,0) 

and 

"2  = 1 ’ '=> 

Packaging  Equation  (6)  and  Equation  (7) 


Using  Equation  (9)  in  Equation  (1)  we  find 


where  the  interval  width  is 


Packaging  the  powers  of  Equation  (12) 
<t  = <TD(t") 

where  the  diagonal  matrix 


D(t^)  - 


,d-l 


Transposing  Equation  (14)  and  forming  the  metric 
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t^^dt  = 


(16) 


or 


(17) 


Case  II  = Transformation  Metric  (-1,1)  ->•  (-t2»t2)«  Consider  next 
the  case  for  the  i nterval 


(Ti,T2)  = (-1,1) 

and  we  want  the  metric  for  the  case  of  symmetry  about  0 

(ti,t2^  - 


(18) 


(19) 


i 170 

i 


A 


as  shown  in  Figure  (1) 


FIGURE  CD 

SYMMETRIC  SPAN  ABOUT  ORIGIN 

Using  the  limits  of  Equation  (18)  and  (19)  in  Equation  (1) 
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Using  Equation  (22)  in  Equation  (1) 
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Idt  = 2t2  = «£ 


(24) 


Hence  in  terms  of  the  interval  width  (Legendre  interval  w 
t^ 


T = 


(25) 


w. 


or 
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and  packagewise 


(28) 


<J  = <TD(t^) 


(29) 


Note  that  Equation  (29)  is  the  same  transformation  as  Equation  (14),  how 
ever  the  metrics  are  different , since 


^t  dt  - t2D(t2) 


1 

t^^t  dt  D(t2) 


(30) 


since  the  metric  M(-l,l)  has  zeros  and  even  powers  as  given  by  Equation 
(145)  of  Section  ( 4 ). 
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Using  Equation  (36)  in  Equation  (1) 


and  solving  for  t 
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The  width  of  the  integration  interval  is 
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1 By  Figure  (2)  set 
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i hence 
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t = t^  + t ■* 

(42) 
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' and 
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dt  = dt  ' * w^d  T 
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j If  ti  is  different  from  zero  normalize  Equation 

(42)  as  non-dimens ion- 
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! al  time 
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(44) 
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X = X ' + 1 


Using  Equation  ( 22 ) of  Appendix  A 
^x  = <x'  B 

where  B is  the  binomial  matrix.  Also 

<H=<tri 


and  by  Equation  (41) 


<X-  =<T 


L 

Using  Equation  (47)  and  Equation  (48)  in  Equation  (46) 

<(t  = <j  B D(tJ) 

= <'  ’’xt 

Transposing  Equation  (49) 

t>  = D(tJ)  b"^  D'^(t5^)  ^ 
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(48) 

(49) 
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and  forming  the  metric-matrix 
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or 

”tt^^l’'^2^  " ^^(0.1)  T (52) 

where 


T . = D"^(t”)  BD(t") 

Tt  11 


(53) 


Using  Equation  (53)  in  Equation  (52) 


”tt^'*'l’'*'2^  ^ B'^D'^(t")  H^j^^D"^(t")  BD(t")  (54) 


As  example  of  the  validity  and  the  appearance  of  the  results  of 
Equation  (54)  consider  the  3x3  case  which  the  left  hand  side  of  Equation 
(54)  is 
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The  three  center  matrices  of  the  right  hand  side  of  Equation  (54  ) 
are jWhere  w is  given  by  Equation  (40), 


"^1 


2t^ 


0 t. 


If  one  multiplies  out  the  terms  of  Equation  (53)  and  uses  the  rela- 
tions 

t2  - = (t2-tj^)(t2+tj^) 

t2  - 

= (t^-t^Xt^+t^tj^+t^t^+t^) 

(t2-ti)  = (t2-tj^)(t2+t2tj^+t2t^_t2tj^+t^) 


or  in  general  for  x and  y 


- y’^  = (x-y)(l,y,y^,. . •y’^'^)  p 


1 1 
1 X 


x"  - y’^  = X <^y  L x(^  - y <^L  x(^ 


where  the  linear  convolution  matrix  L is 


It  is  shown  in  Equation  (117)  of  Section  ( *+  ) that 
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If  Equation  (63)  reduces  to 

M„<0,t2)  = tj  D(t")  Hj„  DCtJ) 
Which  agrees  with  Equation  (17). 


(64) 


Case  IV  - Transformation  Metric  (-1,1)  ->•  (-t2,tc,t2) • Consider  next 
the  translated  and  scaled  symmetric  interval  corresponding  to  (-1,1)  the 
Legendre  case  about  a translated  origin  at  tc  the  center  point  of  the 
symmetric  interval  as  shown  in  Figiare  (3). 


Ji- 

+1 


t 


- t"  -*■ 


CENTER 

POINT 


FIGURE  (3) 

SYMMETRIC  SPAN  TRANSLATED  TO  tc 


t2 *; 
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The  variables  are 


t = t + t"  (65) 

c 

By  Equation  (l)  the  t variables  end  points  with  midpoint  at  zero  is 

^^l’^c’^2^  = (-1,0,1)  (66) 

Consider  next  the  translated  and  rescaled  end  points,  the  span  length  is 


and  the  midpoint  is  translated  to 


t 

c 


(67) 


(68) 


(69) 


(70) 


(71) 


..J 


Using  Equation  (71)  in  Equation  (l) 


r 


(t„+ti  ) 


and  solving  for  t 

. (t  -t  ) 

t + T 


(72) 


2 2 
or  by  Equation  (64) 


t = t + t 
c 


(73) 


(74) 


where 


“t 

2 2 ^ 


The  differentials  are 
(t  -t  ) 

dt  = - dT 


(75) 


(76) 


dt  = dt 


(77) 


(26). 


We  see  by  Equation  (73)  if  ti=-t2  then  Equation  68)  reduces  to  Equation 


If  we  normalize  Equation  Equation  (74) 


or 


t t"  ^ 
t“  = — + 1 
c c 


X = X +1 


(78) 


(79) 


Using  Equations  (81),  (82),  and  (83)  in  Equation  (80) 


<“[(i)"]  =<'4(^)i  “pc)]' 

4 =<tD[(^)"]  o[{kcY]  ““[(i)”] 


<t  =<,  T, 


Transposing  and  forming  the  metric  via  use  of  Equation  (76) 


f = / T><,dT  V(t2-q) 


By  Equations  (74)  and  (i4C)  in  the  Appendix  A we  can  also  express 


<t  = <t''  T^(tc) 


and  by  Equation  (70)  in  Equation  (88) 


• t = <,D 


<t  =/t  T 


V xt 


By  Equations  (89)  and  (88) 


V«> 


= ” iHY]  “ [(i)”] " 


Note  that  there  are  three  different  metrics  corresponding  to  the 
intervals  of  Figure  (4) 


o -T  ->• 


I > ' 


tl~tc-(t2-tj_) 


t2=tc  t f 


FIGURE  (4) 

TRANSLATED  SYMMETRIC  SPAN 
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Case  V - Transformation  Metric  Due  to  Sign  Change.  Consider  next  a 
variable  change  in  sign  on  the  interval  (0,1)  by  Equation  (1) 


we  want 


or 


T = -t 

as  shown  in  Figure  (5) 


(101) 


1 _ 

1 T — » 

1 

1 

-1 

f — - 1 

1 

+1 

and 

dx  = (-l)dt 
packagewise 

= <T  I(-l) 
The  metric  is 


FIGURE  (5) 
AXIS  REVERSAL 


I t)>  < t dt  = I(-l)  / (-1)t^<t  dr  I(-l) 


(102) 


(103) 


(104) 


For  the  3x3  case  is  for  example 

“-1  1 -1 

/ t(^^)t  dt  = i -1  1 

o ' ^ 2 3 4 

-1  1 -1 

L 3 4 5 

The  right  hand  side\of  Equation  (104)  is 


(105) 


By  Equation  (1) 


T = b + b^t 
o 1 


at  the  T end  points 

(•^1,  T^)  = (0,1) 

and  at  the  t end  points 

(ti,  t^)  = (t^,  t^) 

or 

\ 


or 


b>  = 


-1 


.^f-^bJ 


and 


T = 


and  solving  for  t 


t = tf  - (tj-tj^)T 


Define 


t'"  = (t_-t,  )t  = w t 
f b g 


hence 


t = tf  - t' 


and  differential-wise 


dt  = -dt""’  = (t^-tj^)dT 


The  end-points  on  the  t"'  variable  are 

-C.) 

Package-of-powers  Equation  (113)  yields 

<(t'"  = <T  D(w  ) 

^ g 

also  by  Equation  (114) 


= t^-t 


or  nomalizing 


II''  =1-1- 


and  packaging  into  a row  vector 

= <(tD"^(t^)RD(t^) 

= <(t 


The  metric-matrix  for  <(t"'  is  by  Equation  (120),  Equation  (116)  and 
Equation  (115) 


w 


o 


dt  T 


tt 


> 


also  by  Equation  (117)  and  Equation  (115) 


w 1 

e ^ V ✓ 

/ t'"  t'^dt'"  = w D(w  )/  T>  <j  dt  D(w  ) 


or 


= WgDCWg)H.^^D(Wg) 


also  by  Equation  (118) 


-(t-tj) 
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(125) 


and  by  Equation  (120 ) Section  ( A ) 

<t—  = T^(-t^)I(-l) 

and  another  expression  for  Equation  (120)  is  obtained  by  equating  the 
matrices 


’^t,t'"  ^ D“^(t^)RD(t^)  = T^(-t^)I(-l)  (126) 

As  examples  of  the  way  the  results  look  let  the  X"'  end  points  be 

(ti"'%t2''')  = (0,1)  (127) 

and 


and 


t^-t,  = w = 1 

f b g 


(128) 


= 1 (129) 

and  by  Equation  (129)  in  the  diagonal  matrix  of  Equation  (126) 

D(tj)  = I (130) 

hence  Equation  (126)  becomes 

Tt^t''"  = ^ = T^(-1)I(-1)  (131) 

Where  by  Equation  (33  ) Appendix  A 

T^(-l)  = B(-l)  = (132) 

and  the  connection  matrix  is 

(133) 

The  metric  of  Equation  (121)  using  integration  limits  of  Equation 
(108)  for  t becomes 

^ V ✓ T ° 

f = rV(-1)  t\/t  dt  R (134) 

o 1 


or 


H.,.  = R^H.^.R 
ill  111 


(135) 


a novel  result  which  cays  that  the  Hilbert  matrix  is  congruent  to  itself  via 
the  Rutishauser  matrix. 
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(145) 


The  package  of  powers  of  Equation  (143)  is 
<t  = <^T  0(2^) 

and  transposing  and  forming  the  metric  (B  is  binomial  matrix) 


f ty  <^t  dt  = B"^D(2")J  (2)t^<t  dr  D(2")B“^ 


(146) 


or 


M .(-1,1)  = B"'^D(2")  H.  D(2")B~^2 

^ ) X XX  J. 


For  the  3x3  case  one  has 


’2  0 2 ' 

0 

0 

> — 1 

1  

0 

0 

1 

'1  1 1 

3 

2 3 

0 2 0 

=2 

-110 

020 

111 

3 

2 3 4 

2 0 2 

1-2  1 

2 

0 0 2 

111 

_3  5 

3 4 5 

’1  0 O' 

‘1-1  1‘ 

0 2 0 

0 1-2 

2 

Lo  0 2 J 

.0  0 1. 

(147) 


(148) 


Multiplying  the  matrices  on  the  right  yields  the  equivalence  relation. 

The  interesting  aspect  of  the  above  case  is  made  apparent  when  one 
attempts  the  transformation  (0,1)  to  (o,-l)  simply  by  changing  the 
limits  of  integration 


-1 

/q  dt 


2 

T T 

2 

3 


-1 


(149) 


I 


• -1  1 -1 " 

2 3 

1-11 

2 3 4 

-1  1 -1 

3 4 5 

which  does  not  qualify  as  a metric  matrix  since  the  norms  on  the  main 
diagonals  have  negative  signs.  This  is  avoided  when  one  changes  variables 


thus 

T = -t 

(150) 

and 

dr  = -dt 

(151) 

and  by 

Equation  (150) 

<t  = <T  K-l) 

(152) 

and 

-1  1 

/ t^/t  dt  = (-l)I(-l)  f T>  <T  dt  K-l) 
o'  0 ^ 

(153) 

-1  1 
/ t>  /t  (-dt)  = K-l)  / t'><t  dx  K-l) 

0 ' ^ 0 

(154) 

or 

-1 

M^^(0,-1)  = / t(-dt) 

(155) 

and 

B, 

K = K-l)  M (0,1)  I (-1) 

t,t  TT 

, TRANSFORMATIONS  ON  GRAM-SCHMIDT  VECTORS  FROM  CLASSICAL 

(156) 

INTERVALS 

TO  ARBITRARY  INTERVALS. 

Case  1 - Transformation  Gram-Schmidt  Vectors  from  (0,1)  Interval  to 
(-1,1) . The  orthonormal  Gram-Schmidt  vectors  were  derived  in  Section 
( 1 ) Equation  (337)  for  the  (0,1)  interval  as 

<s(0,l)  = <T  B^(0,1)  (157) 
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n 


where  the  coordinate  matrix 

is 

for  3x3 

1 

-/3 

/s" 

53(0,1)  = 

0 

2/3 

-6/5 

0 

0 

6/5 

(158) 


We  seek  to  derive  the  orthonormal  Gram-Schmidt  vectors  previously  obtained 
on  the  interval  (-1,1)  called  the  modified  Legendre  polynomials  via  trans- 
formation matrices  rather  than  proceeding  through  the  Gram-Schmidt  con- 
struction equations  given  by  Equation  (384)  of  Section  ( 1 ).  Let 


<s(-l,l)  = 4 Bg(-l,l)  (159) 

where  B^(-l,l)  is  unknown  and  where  the  connection  of  Equation  (145)  is  used 


<t  =<T  D(2")B-1  =<T 

Using  Equation  (160)  in  Equation  (159) 

<J(-1,1)  = <(tD(2’^)b"^B^(-1,1)  (161) 

Transposing 

s(-l,l))>  = Bg^(-l,l)  b"'^  D(2'^)t^  (162) 

Forming  the  0,N  metric  (constant) 

1 

/ s(-l,i)^  <s(-l,l)dt  = I = MggC-1,1)  (163) 

or  by  Equation  (144) 

I = b'^(-1,1)b"'’’d(2")  ; (2)  T TdTD(2")B"^B  (-1,1)  (164) 

® 0 ® 


or 

I = 2B^(-1,1)b"'^D(2”)H.,-D(2”)B“^  (-1,1)  (165) 

s 111  s 

By  Equation  ( 348)  of  Section  ( 1 ) the  triangular  factors  of  the  Hilbert 
matrix  are 

(0,1)  = = [B  (0,1)b'^(0,1)]"^  (166) 

XT  ill  S S 

Modifying  Equation  (165) 

B^(-l,l)  b"^(-1,1)  = [Bg(-l,l)Bg(-l,l)]'^ 

=2B‘'^D(2")[B^(0,1)B^(0,1)]~^(2")B“^  (167) 


iiL 


mF 
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(176) 


M (O,®)  = 

TT 


for  i, j=0,l,2, . . .d-l 

Case  I - The  Variable  Change. 
T = -t 


and 


dx  = -dt 


and 


-ax  at 
e = e 


yields  for  the  powers 
<x  = <tl(-l) 


The  end  points  for  the  new  variable  are 


(ti*  t^)  = (0,  -<») 

and  the  metric  is 


(177) 

(178) 

(179) 

(180) 

(181) 


/ e ^^dx  = I(-l)/  ^ e^^(-dt)I(-l)  (182) 

0 0 

By  Equation  (23)  in  Appendix  B 


/ e^^t^  ^t  dt 

0 


(i  t j)  ! (-1)^^^^^' 


i+j+1 


f 


(183) 


(184) 


and  we  see  as  in  Equation  (149)  that  the  diagonal  elements  have  negative 
signs,  hence  do  not  serve  as  a good  metric.  By  Equation  (182)  define  the 
metric 
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M (0,-<»)  =/  t \ ^te^^(-dt)  = -/  e^^dt 


(185) 


and  using  Equation  (184)  in  Equation  (185) 


M^^(0,-<x.)  = -1 


2!  -3! 


(186) 


2!  -3! 


and  the  metrics  are  connected  via  Equation  (186)  in  Equation  (182) 
M (O.oo)  = I(-l)  M^^(0,-«>)I(-1) 

TT  tt 


(187) 


M^^(0,-“)  = K-l)  M^^(0,«)I(-1)  (188) 

and  the  inverse  metrics  are  related 

M^J(0,-“)  = I(-1)m"^(0,»)I(-1)  (189) 

The  inverse  metric  on  (0,oo)  is  given  by  Equation  ( 123)  Section  ( 2 ) 


m"^(0,«>)  = a -3a  5a^ 


and  the  inverse  of  Equation  (190) 


M“^(0,-<»)  = a 3a  5a^ 


Case  II  - If  we  translate  the  origin  to  a new  origin  t^^  0 where 
T = t^  + t 


(190) 


(191) 


(192) 
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then  the  metric  for  the  variable  t on  the  interval  (O,®)  can  be  written  as 

T CO 

dT  =/  t)>  dT  +/  ^ dT  (193) 


=•'’  k ^ ^e 

0 0 t. 


The  first  term  on  the  right  is  rather  messy,  however  the  second  integral 
is  interesting.  For  the  3x3  case  we  obtain 


M^^(t^,®)  = / <^T  e 


-at 


dT 


(194) 


=e  1 


1 

(tq+l) 

(tj+2t  +1  ) 

a 

a a 

(tq+l) 

(t^+2t  +1  ) 

(t^+3t^+6t  +3 
i. i.  q 

d 

a a 

a 2 a'^ 

a 

(t^+2t  +1  ) 
i.  2 

(tJ+3t^+6t^+3  ) 

(t‘|+4t^+12t^+24t.+12 
11  1 **-11 

a a 

a 2 a^ 

a 

a 2 3 a 

a a 

(195) 


D.  TRANSFORMATION  OF  THE  GRAM-SCHMIDT  VECTORS  FROM  (0,°o  ) (0,-».  ) 

INTERVALS . The  Gram-Schmidt  proceedure  was  applied  to  derive  the  ortho- 
normal modified  Laguarre  functions  of  Equation  (42  ) Section  ( 2 ) for 
the  3x3  case  as 


<s(0,  ) = <^gBg(0,®) 


(196) 


where 


B^(0,“)  = 


1 

0 

0 


-1  1 

a -2a 
0 a^ 


(197) 


The  0.  N.  Gram-Schmidt  vectors  on  [0,-®]  is  given  by 

<J(0,-»)  = <^tgB^(0,-“) 


(198) 


where  B^(0,-®)  is  unknown. 
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Transpose  Equation  (198)  and  form  the  metric 


/ s(0,-«>)^  <^s(0,-®)(-dt)  = ^^(-dt)b^(O,- 

0 0 


or 


I = B (0,-oo)  ^ (0,-<»)  B (0,-«>) 

s t t s 


e e 


Using  Equation  (188)  in  Equation  (200) 


I = B (0,-<»)I(-l)M  (0,-®)I(-l)B  (O.-oo) 

S T T S 

e e 


and  the  triangular  factors  of  Equation  (417)  Section  ( l ) 


\ ^ (0,“>)  = [B^(0,»>)B^(0,oo)]“^ 
e e 


and  as  before 


CB^(0,-o.)B^(0,-®)]~^  = I(-1)[B^(0,oo)B^(0,<»)]'^I(-1) 


or 


B (0,— )b'^(0,-«>)  = I(-1)B  (0,o=)b’^(0,»)I(-1) 
s s s s 


and  if  one  attempts  as  a solution 
B (0,«)  % I(-1)B  (0,“>) 


S'’  ■ s 

and  for  the  3x3  case  we  have  by  Equation  (197)  in  Equation  (205) 


o 

0 

• — 1 

1  

1 — 

*— 1 

1— 1 

B^(0,-»)  ? 

0-10 

0 a -2a 

. 0 0 1. 

2 

0 0a 

2 _ 

ra 


or 


B^(0,-®)  » 


1 

0 

0 


-1 


-a  2a 
2 


2 J 


If  we  perform  the  0.  N.  Gram-Schmidt  process  using  the  metric  of 
Equation  (186) 


Section  4 


POLYNfyilAL  VECTORS.  BASES.  BASE  CHANGES.  POLYNOMIAL  DERIVATIVES, 
BASE^hKiVATh^  AND  ^SE  iNTfctiRALS,  It  is  well  known  ^roni  elewentarv 
algebra  texts  (see  for  example  Halmos  Ref  l36  ])  that  the  set  of  poly- 
nomials of  degree  d-1  form  a vector  soace  of  degree  d,  for  example 

x(t)=ay+aj  t...a^_^  t'^'^  (1) 


is  a vector.  The  coordinates  are  aQ.a,  ...  aj_i  and  the  base  elements 
are  the  powers  of  t.  If  we  separate  the  coordinates  ^rom  the  base 
elements 


x(t)=(l,t,t'‘ 


a 

a 


1 

2 


(2) 


a 


d-lj 


or 


x(t)=  ^ ^ 

where  the  column  of  field  elements  is 


and  the  row  of  base  vectors  is 

^t  - (t°,t\t^  ... 


(3) 


(4) 


(5) 


200 


Equation  (5)  is  a row  of  d base  vectors,  that  is  the  i^  base  vector 
is  the  polynomial  ti.  The  d base  vectors  are  linearly  independent 
etc.  Any  full  rank  invertible  dxd  matrix  B maps  the  /t  base  to  a 
new  base,  for  example 


^ B 
^dxd 


(6) 


or 


^t 


Some  examples  of  base  changes  commonly  occurring  in  classical  math- 
ematics are  given  below. 

Linear  Scaling  and  Translation  on  the  Time  Axis. 

T = bii  * bj2  t 

or  simplifying  the  notation 

T = bp  > bjt 

or  nomalizing  the  coefficient  of  t in  Equation  (8) 


where 


T s bj  (6+t) 


B = bp/bj 


By  Equation  (59- a )*  the  binomial  term  of  Equation  (8)  yields 


(7) 


(8) 


(9) 


(10) 


(11) 
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By  Equation  (12)  we  see  that  the  bases  are  connected  by  a diagonal 
matrix  D times  an  upper  triangular  matrix  Ty(B)  containing  the 
binomial  coefficients  or 

(13) 

where 


MtT  * D(bj)  Ty(B)  (14) 

The  inverse  base  change  is 

(S)  ir^(bi)  (15) 

The  diagonal  matrix  inversion  is  simple,  the  upper  triangular  matrix 
inversion  is  more  complicated.  However  the  inverse  can  be  constructed 
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easily,  for  by  Equation  (9) 

and  by  Equation  (60- A ) 


<-<  ji 

) 


b(d.l) 


0 

1 

-2bo 

-4bJ 

='>0 

0 

0 

1 

.3bo 

^>>0 

-10b 

0 

0 

0 

1 

f 

.u 

cr 

o 

10b 

! " 

0 

0 

0 

1 

-5b 

Lo 

0 

0 

0 

0 

1 

Consider  the  derivative  of  Equation  (2) 


For  many  studies  the  vector 

^ => 


is  a constant  and 
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For  filtering  example  of  varying  parameters  see  paper  by  Luenberger  [54]. 
The  derivatives  of  the  base  polynomials  in  the  sane  base  is 


The  matrix  of  equation  (22)  is  singular,  or  the  polynomial  derivatives 
arc  linearly  dependent.  From  the  above  we  see  that 


<^.<t 


— <t  = <5  v” 


< = <t  V'*  . <t  [0] 


and  the  singular  velocity- matrix  V is  said  to  be  nilpotent,  index  d,  that 
is 

V‘^  » 0 (25) 

Note  the  interesting  dyadic  decomposition  of  V as  a sum  of  rank  one 
dyads 

V = 1 Ej2  > 2 ^23  . 3 L3,  * . (d-l)  (26) 

where  each  rank-one  dyad  is 


(28) 


and  the  row-vector  of  dimension  d has  a 1 in  the  position 

<J)e  • (0,  0 ...  1,0,0  ...  0) 
i.  position 

The  matrix  V can  also  be  partitioned  into  its  column  space  or  row 
space  as 


(d-1)  ^ 

or  as  factors 

V = N S 


(29) 

(30) 


(31) 


where  the  shift  rif»ht-and-out  operator  is 
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The  shift  is  on  the  identity  matrix 


N is  a diagonal  matrix  of  natural  numbers 


Powers  of  V can  be  obtained  from  liquation  (22)  utilizing 


li.  . E, 

ij  km 


0 j^k 


E.  j=k 
im  •' 


since 


where  the  inner-product  is 


1 i=k 

.0  j+k 


is  the  familiar  Kronecker  delta  function.  Consider  the  square 
or  the  expression  of  Equation  (22) 


» 1.2E,,  ♦ 2.3E,.  ♦ 3ME-.  + 4*5E., 


♦ • • • 


♦ (d-2)(d-l)  E 


( d-m ) TOW 


m rows 
of  zeros 


the  (d-1)  power  is 


= (d-1)! 


the  d 


th 


power  is 


V 


d 


0 


as  an  example  consider  the  fifth  degree  polynomial,  or 
<^=(lft,t,t,t,t) 
for  which 

0 1 0 0 0 0 

0 0 2 0 0 0 

0 0 0 3 0 0 

0 0 0 0 4 0 

0 0 0 0 0 5 

0 0 0 0 0 0 


V = 
6x6 
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I- u.. 


i 


[ 


l-2*3*4*5Ej^ 

0 


The  coefficients  are  factorials  and  factorial  relations. 

The  matrix  V can  also  be  written  as  the  oroduct  Equation  (32)  and 
Equation  (34)  as 


(58) 

(59) 


I 

i 


V 

dxd 


NS 


uo 


(60) 


0 0 


The  psuedo-inverse  of  the  singular  matrix  V is  used  later  in  multi- 
ple integrals.  Two  expressions  for  the  psuedo  inverse  are 


* T T * 

V - V (W  ) 


(62) 


f nr 


T T 
» (V*V)*V* 

The  transpose  of  Equation  (61)  is 


T T 
V * S N 
uo 


The  symmetric  Granunian  matrix  of  Equation  (63) 


VV 


NS  N 

uo  uo 


The  product  by  Equation  ( 32  ) is 

1 


T 

S S 
uo  uo 


and 


(W^)* 


I 


- <J 

1 . 

. 2' 


e • 


(d-l)‘ 
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(V*)‘ 


(m^l) 


th 


0 

0 

ml 

U 

0 

0 


0 

0 

0 

0 

1 

(m+l) ! 
0 

0 


The  associated  projectors  are 


VV* 

dxd 


1 0 0 
0 1 0 
0 0 1 


and 


I - W‘ 


0 0 0 
0 0 0 
0 0 0 
0 0 0 
0 0 0 


0 0 0 0 0 

0 0 0 0 0 

0 0 * 0 0 0 

• 

0 0 * 0 0 0 


0 0 0 0 0 


0 


0 0 0 0 


(d-n) ! 

”31“ 


0 


...  0 


0 0 
0 0 
0 0 
0 0 
0 1 


From  the  preceeding  we  have 


or  the  d states  in  matrix  fom 

= Ty(t)  a^  (73) 


The  derivative  of  the  state  vector  of  (69)  multiplies  the  package  by 
V,  that  is 


Consider  the  matrix  T^Ct)  of  EquatiMi  (72) 


0 

0 

2 

2.3t  3.4t^  4.5t''  . . . 

{d-2)(d-l)t“ 

0 

0 

0 

2.3  2.3.4t  3.4. St^  . . . 

(d-3) (d-2)(d-l)t 

0 

0 

0 

0 2.3.4 

• 

000  00  0 1.2. 3.4  ...(d-3)(d-2)(d-l) 

The  matrix  evaluated  at  t*0  is 
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The  inverse  of  (o)  is 


t;^(o)  = 


10  0 


0 10 

„ „ 1 


0 0 ^ 


1 

(d-D! 


The  inverse  of  the  triangular  matrix  of  Equation  (75)  for  a second  degree 
polynomial  is  the  3x3  matrix 


■r^(t)  = 1 -t 


0 1 -t 

0 0 1/2 


and  for  a third  degree  polynomial  with  a 4x4  matrix 


1 

-t 

t2/2 

-t'/2 

4x4 

0 

1 

-t 

t2/2 

0 

0 

1/2 

-t/2 

0 

0 

0 

1/2-3 

and  for  a fourth  degree  polynomial  the  5x5  matrix  is 


T"^(t)  « 

1 

-t 

t^/2 

-t^/2‘3 

tV2*3*4 

5x5 

0 

1 

-t 

t2/2 

-t^/2.3 

0 

0 

1/2 

-t/2 

t2/4 

0 

0 

0 

1/2*3 

-t/2. 3 

0 

0 

0 

0 

1/2. 3.4^ 

The  nested-nature  of  the  size  of  the  matrices  can  be  seen  from  the 
above  relation.  A size  expanding  recursive  inverting  algorithm 
could  be  worked  out  (the  analog  of  the  recursive  Householder  inversion 
lenina  for  a matrix  plus  a dyad). 

Time  Derivatives  of  TVo  Time-Varying  Bases.  Polynomial  bases  of  the 
foim  ^ or  ^ where 

<^=  (1,  t,  t^  ...  (81) 

and 

<r,  2 d-1. 

= (1,  T,  ...  T . ) 
can  be  referred  to  as  monomial  bases. 


An  arbitrary  base  of  Equation  (6)  is 

and  the  time  derivative  is 


(82) 


(83) 
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..  


or  by  Equation  ( 24)  **nd  Equation  (33  ) 

§ t*") 

base  e 

or 

B = BV  - V^B  (86) 

X t 

If  B=C  a constant  matrix  one  has 

C = BV  - V^B  (87) 

Equation  (83)  is  exact  analog  of  time  varying-bases  in  classical 
dynamics  of  Gibbsian  vectors. 

If  = -V^  Equation  (86)  becomes 

B * BV  + VB  _ (88) 

If  the  transformation  between  the  bases  is  a constant  then 

BV^  = V^B  (89) 

or 

V » V^B  (90) 

X t 


or  the  velocity  of  the 


<b 


lements  in  the  base  is 


B 


b"^  bJ 


(85) 


which  is  the  familiar  similarity  transformation 


Multiple  Integration  of  Bases  and  Base  Dyadic  Product  Integration. 
Consider  the  indefinite  integral  the  base 

I dt  * ^ I dt  , I t dt,  I t‘^"^  dt  ^ 


•( 


t. 


2 3 

t t 


Equation  (91)  can  be  written  as 

|<^dt=<^V*+  ^ <^( 


(91) 


(92) 


where  the  psuedo  inverse  matrix  V*  is  given  by  Equation  (65).  Notice 
that  the  derivative  of  Equation  (92)  yields  a matrix  Calculas  or 
linear  product  relation 


(94) 


Relations  for  higher  orders  can  be  written  out. 

Integration  of  Dyadic  Product  of  Bases.  Among  the  many  relations 
occuring  in  polynomial  analysis  the  integral  of  the  dyad 

j 

is  used. 

It  is  useful  to  express  Equation  (91)  as 

I <^dt  = t(l,  1/2,  1/3,  1/4  ...  1/d  j 
where  the  diagonal  matrix  is 


1 0 
0 t 
0 0 t' 


0 0 t 

The  integral  of  t is 


d-1 


I t<^dt  = [ 1/2,  1/3,  1/4,  ...  1/d, 

and  the  integral  of  t™^^  is 

(t  2 

t^C^dt  = t^^^^l/m,  1/m+l,  .., 

h 

The  integral  of  is 


1/m+d 


)“t 


(103) 


\d 


where  the  well  known  Hilbert  matrix  is 


Note  tliat  tlie  Hilbert  matrix  is  a special  case  of  the  Hankel  matrix. 
The  integral  of  Uquation  (102)  is  given  by  Equation  (19)  Section  II. 


B.  INNER- PRODUCTS,  BASE  METRICS,  HANKEL  AND  HILBERT  MATRICES. 

The  classical  vectors  ana  'dyads  of  Gibbs  carried  along  the  bases  with 
the  vectors  and  the  operators  (or  transformations) , Modem  abstract 
mathematics  attemnted  to  surpress  the  bases  and  represent  the  vector 
as  a row  or  column  n-tuple  and  the  matrix  as  a nxm  matrix  of  elements 
(usually  field  elements).  This  was  adequate  for  simple  systems  but 
where  derivatives  and  many  base  changes  are  needed  for  large  scale 
math-models,  the  matricized  version  of  the  Gibbsian  representations 
simplifies  many  operations  on  multi-linear  dynamical  algebras.  Tliese 
extended  Gibbsian  techniques  have  been  well  developed  for  flight 
dynamics  of  multiple  inner-acting  bodies  characterized  by  symmetric 
inertia  matrices,  or  variance-matrices  of  measurements  in  many  onboard 
moving  bases  (reference  69).  The  extension  of  these  techniques  to 
polynomial  vectors,  etc.  provides  some  interesting  relations  and 
relates  matrices  to  some  very  tedious  age  old  classical  analysis 
techniques. 


Consider  two  polynomials 


Ci(t)=  ^<^y> 


(104) 


x^(t)  = a/  . ....  aj_^t  = ^ 


(wliere  is  conventional  inner  product  on  real  n-tuple  vectors), 

nni]  ^ 


»2(t)  - 2 


then  the  ’’dyadic  ;>roduct"  of  tlie  two  vectors  and  x^  is 

^12  ■ X >2 


where  the  square  dxd  rank  - one  matrix  or  dyad  is 


><  = 


(t.d.d  t^-') 


><  = 


t'  t^ 


t^ 


td-ltd-1 


(105) 


(106) 


(108) 


r:: — idi 


or  as  a column  of  row  vectors 


X ■ 


< 
‘ < 


and  as  a row  of  column  vectors 


Clearly,  the  symmetric  dyad  is  a rank-one  Hankel  matrix 


X- 


1 t t“ 

t t^ 

t^  t^  t*^ 

t^  t' 


t'  t'’ 


.d-1 


,.d+l  d+2 
l_t  t 


2d-l 


t2d-^ 


(109) 


(110) 


(111) 


The  psuedo-inverse  of  (111)  is 

(><)■  • 

The  inner  produce  of  the  two  polynomials  on  the  interval  0 to  1 is 

’‘1-2  1‘  ><‘‘')>2 


(112) 


(]13) 
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The  integral  over  the  unit  interval  is  the  Hilbert  matrix 


lo>< 


1 1/2 
1/2  1/3 


1/d+l 


1/d+l 


l/2d-l 


1/d+l 


(114) 


The  matrix  of  inner-products  between  the  base  vectors  is  classically 
called  a metric-matrix,  thus  the  metric  matrix  with  respect  to  the 
inner-product  so  defined  is  a Hilbert  matrix. 

The  inner-product  defined  over  an  arbitrary  normalized  interval  can 
be  written  by  F.quation  (148  ) sec  (1)  as 
t. 


^2"^1 


><i 


dt  = 


(115) 


= t H. 

^ t ‘tj 


(116) 


\ H.  . - t,  H.  „ 1 - — L_ 

^1^2  L ^ ^2  ^2  ^ ^1  ^1  J ^2  " ^1 


For  example  if  tj=0,  then 


(117) 


Mo*  “ R*  M-o 

0t2  t,  i)l  t2 


(118) 


r — ^ ^ r* 


r* 


.u-l 


1 

1/2 

1/3 


1/2 

1/3 


1/3 


• • 


(119) 


.d-1 


For  exanple  for  the  fifth  degree  polynomial  of  Equation  (3)  Section  I,  the 
(0  ,1)  interval  of  Equation  (113)  is 


(120) 


H.  » 

U 

1 

1/2 

1/3 

1/4 

1/5 

1/6 

6x6 

1/2 

1/3 

1/4 

1/5 

1/6 

1/7 

1/3 

1/4 

1/5 

1/6 

1/7 

1/8 

1/4 

1/5 

1/6 

1/7 

1/8 

1/9 

1/5 

1/6 

1/7 

1/8 

1/9 

1/10 

1/6 

1/7 

1/8 

1/9 

1/10 

1/11 

For  the  third  degree  polynomial  the  interval  (0,  t^) , t2=t-  of 
Equation  (118)  is 


Ot- 

4x4" 


^f/2 

^f/3 

’^f/4 

CM 

'f/5 

2 

f/3 

4/6 

3 

f/4 

^f/5 

^f/6 

^f/7 

(121) 
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(122) 


(123) 


C.  CONTINUOUS  TIME  SHIFT  BASE  CHANGES.  BASE  TRANSITION  MATRICES 
AND  HA.^EL  ?tETRIC41ATRI^J  F<m' mfp  Ih  lV»ction  ! it  is 

shown  that  a linear  scaling  and  translation  on  the  time  axis  generates 
a triangular-matrix  base  change.  In  Section  I it  is  shown  that  the 
metric-matrix  for  a monomial  base  change  on  a normalized  time  interval 
tj  to  t2  generates  a Hankel  matrix.  This  section  will  show  how  trans- 
lation on  the  time  axis  (to  the  front,  back,  and  center  of  a time 
interval)  change  the  form  of  the  Hankel  matrix.  Clearly  the  most 
simple  metric  would  be  an  identity  matrix,  the  result  of  a Gram-schmidt 
orthogonalization  process  (orthogonal  polynomials).  Smoothing  over 
a span  and  estimating  states  at  forward,  backward  and  span-center 
occurs  quite  often. 


( 

I 


f 


The  tine  dianges  and  variables  are  shown  in  Figure  (1).  The  variable 
tg  is  some  fixed  initial  time,  the  variable  t|,  is  the  tine  point  at 
the  back  of  the  span,  the  time  tf  is  the  front  point,  and  tg  is  the 
center  or  mid-point.  The  width  of  the  interval  tf-th  is  designated 
as  W. 


W/2 


The  equivalence  relations  by  Figure  (2)  are 


4 


♦ t"  ■ t»  - t' 

DC  JL 


(124) 


If  we  solve  each  of  the  new  variable  equations 
t'  ■ t - t. 


t"  ■ t - t 


t"'  * -t  ♦ t. 


(125) 

(126) 
(127) 


The  lower  and  upper  limits  of  integration  are  t^  and  tf  for  the 
variable  t ; for  the  new  variable  by  Equation  (125)  [parentheses 
meaning  functions  of] 


t'(t)  = t - tj^ 
and  at  the  lower  limits 


(128) 


t'(t^)  = - t.  = 0 


(129) 


and  at  the  upper  limit 


t'(tf)  = t^  - t^  = W 


(130) 


In  a similar  manner  the  lower  and  upper  limits  for  t"  are 


'""b)  ■ 'b  - 'c  ■ - 


(131) 


and 


t"(tf)  = t^  - t^  . W/2 


(132) 


The  integration  limits  for  t'"  are 


t'"(t.  ) » t-  - t.  - W 


(133) 
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and 


t'"(tj)  » 0 


(134) 


If  we  define  powers  of  the  variable  t',  t'",  and  t""  by  Equation 
(11)  Section  I we  obtain  for  a fifth  degree  polynomial 

» [(1.  t'.  (t')^  (t')^,  ...  (t')^] 


0 

0 

0 

0 

0 


‘ -2'b  ^‘b 


0 1 .3t^ 

0 0 1 

0 0 0 

0 0 0 


2 3 

6C  -IOC 

n b 

-"'b  “'J 

‘ -s'b 

0 1 


(135) 


Equation  (135)  can  be  extended  to  higher  degree  polynomials,  where 
the  binomial  coefficents  continue  along  the  columns. 


The  translations  to 
(126)  yields 

the 

origin 

at  the 

center 

of  the 

span 

1 

-^c 

t2 

c 

-t^ 

c 

t^ 

c 

-t^ 

c 

0 

1 

-2t 

c 

3t^ 

c 

.4t3 

c 

5t^ 

c 

0 

0 

1 

-lOt' 

( 

0 

0 

0 

1 

-4t 

c 

2 

lOt 

c 

0 

0 

0 

0 

1 

-Stc 

0 

0 

0 

0 

0 

1 

(136) 
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1 


<t-  . <T(t^) 

•>= 

and  the  dyadic  product  is 

The  metric  of  the  new  base  by  Equation  (139)  and  the  integration 
limits  of  Equations  (129)  and  (130)  are  for  fixed  tj^ 


(139) 


(140) 


(141) 


The  center- referenced  metric  matrix  by  Equations  (131)  and  (132)  is 


(142) 


1 

F 


dt-  - ^ 


T 


■W/2 


-f 

tb 


)><  dt 


T(t^) 


Note  the  symmetric  integration  limits  of  Equation  (142),  it  will  be 
shown  later  how  they  simplify  the  Hankel  matrix.  The  metric-matrix 
for  the  transformation  of  Equation  (137)  is 


(0 


dt'" 


T’^(tf) 


X ‘it 


T(t,) 


(143) 


The  me trie -matrix  of  Equation  (141)  by  Equation  (122)  is 


dt'  = 

1 

W/2 

W^/3 

W^/4 

• e t 

Jo 

W/2 

W^/3 

W^/4 

w'i/s 

• • • 

W^/3 

W^/4 

w'^/s 

W^/6 

• • • 

W^/4 

w'i/s 

]f^/6 

W^/7 

e e • 

• • e 

• • • 

tee 

• • • 

• • e 

(144) 


The  metric-matrix  for  the  transformation  to  the  center  of  the  span  by 
Equation  (142)  and  Equation  (117)  is 


1 

F 


Wo 


‘ t^  <t"  dt' 
-W/2 
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..SI 


A; 


a 


li 


ii 


t; 


I 

i 


j 


The  third  transformation  Equation  (143)  is  the  negative  of  the  ^irst 
one.  Equation  (144)  or 


One  can  also  obtain  the  transformations  from  the  t'  to  the  t"  ■ 

variables  etc.,  as  done  in  Equation  (138)  and  the  related  dyads  of 

Equation  (140),  > 


TOEPLITZ  STATE  TRANSITION  MATRICES  IN  CONTINUOUS  POLYNOMIALS. 
Polynomials  are  perhaps  the  most  widely  used  approximating  functions 
in  numerical  analysis  approximation  theory  and  in  estimation  theory. 
They  are  essential  to  structure  studies  of  matrices  from  the  spectrum 
point  of  view  in  that  one  considers  characteristic  and  minimal  poly> 
nomials  over  the  complex  field  as  well  as  matrix  polynomials.  The 
approximation  of  exponential  functions  yeilds  polynomials 


e 


A 


I + A + 


(147) 


Consider  the  polynomial 

(148) 

and  its  derivatives  by  Equation  (72)  Section  1 


x(t)  = Sq  •••  a^t  + a2t 


Vl  ^ 


= <^)1 


X = <t  V ^ 

I? 

X = <^  V"  J>  ; 

• A'-, 

• ? '’■ 

* 


(d-1)  ^ ,,d-l 

X " V ^ 


Packaging  Equation  (149)  as  a column  vector  of  dimension  d 


X 

I ^ 

X 

V ^ 

<v 

X 

• 

s 

< 

• 

• 

• 

x(d.l) 

< 

1 

1 

• • > 

• 

• 
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or 


x(t)(^=Ty(t) 

dxd 

where 

T,(t) . r < 

i cf  V 
“ <(v2 


and  by  Equation  (21) 


d 

It 


TyCt)  = t^(t) 


= T (t)  V 

v'-  ^ 


(ISO) 


(ISI) 


(1S2) 


Solving  Equation  (150)  for  the  constant  ^ 

y>=  T‘^(t)  x(t)^  (153) 

Note  that  the  vector  ^ is  a constant  (usually  taken  constant  over 
a time  interval)  and  can  be  evaluated  at  ooints  t=0  or  arbitrary 
point  t|^  hence 

> = t;^0)x(0>  = T;^t^)x(t^)>  (154) 

Using  Equation  (154  I in  Equation  (150) 

X(t)^»  Ty(t)  r^tj,)  x(t^)^  (155) 
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it(t) 


x(t) 


(t) 


TV 


3! 

.2 


IT 


t" 

TT 


Ta-TT! 

.d-2 


THTTir 


x(0) 

i(0) 


x(0) 


(158) 


(d-1) 


‘(0) 


J 


Note  that  Equation  (158)  develops  the  finite  McLauren  series  expansion 
terms  f"or  exact  polynomials,  ‘inis  same  technique  is  used  to  develop 
a Taylor  series  approximation  of  functions  in  Section  V 


The  state-transition  matrix  of  Equation  (155)  is 


x(t|>=  ♦(t,  tj^)  x{tj^j^ 


where 


= T^ct) 


By  Equation  (75)  and  Equation  (80) 


By  Equation  (160)  for  a 5x5  matrix 


♦(t.t.  ) = I 1 


; 0 


t' 
1 

0 0 

0 0 

0 0 


where 


(t^)‘ 

t' 

1 

U 

0 


(t')2 


1 

0 


(tV 


(t')^ 


(t')2 

t' 

1 


(161) 


t'  = t - t. 


(162) 


the  inverse  matrix  of  Equation  (160)  is 


♦ = T^(t^)  r'(t) 


and  by  Equations  (80)  and  (75)  is 

1 -t' 


0 


0 0 
0 0 


(t^)^ 


1 -V 


0 


0 

0 


(tv 


(t')‘ 


-t' 

1 

0 


(t')"* 


(t^)^ 


(t')^ 
1 — 

-t' 

1 


(163) 


(164) 
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By  Equations  (161)  and  (166) 


♦"^(t.tjj)  x(t^ 

Note  that  the  inverse  transition  matrix  is  obtained  merely  by  a 
negative  time  sign,  that  is 

-t' . -(t-t,,) . -t 

substituted  in  Equation  (163). 


(165) 


i 


lers 


t 


•mmmm 


and  similar  for  powers  of  the  inverse 

.-d 


* 


1 

0 


-dt 

1 


(dt')^  (dt')^ 

2!  '3! 


1 


(169) 


dt' 


! 0 0 


0 


1 I 


Transitions  over  Integer  Multiples  of  Time  Intervals.  The  transition 
matrix  by  liquation  (l61)  f'rom  some  time  t^^  to  time  t is 


;(^  = ♦ (t.tj^)  x(t^ 


if 


t = nt. 


(170) 


t-tj,  » (n-l)  t^  = t' 


x(nt'r>=  ♦(ntjj.tj^)  x(t^)^ 


(171) 

(172) 


where  it  is  easily  established 


t(ntb.tb)  . ♦"-‘(tb,0) 


(173) 


also 


♦(ntb,t^)  = ♦ (t^.O) 


(174) 


:J 


J 


(177) 
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= Tay(t-tj^)  x(tj^(dp>  + e 


The  Taylor-Toeplitz-transition  matrix  transfonns  the  states  at  time 
tj^  to  time  t , and  can  be  designated  as 


If  x(t)  of  Equation  (17G)  is  a p dimensional  column  vector  and  time 
differentiable  then  as  a column  of  column  vectors 
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\ x/ 


*/  >«  \ 


(180) 


If  the  column  vectors  x(t)^^  , x(t)^^  ...  etc.  are  packaged 
a row  of  column  vectors  one  obtains 


as 


fx(t)(^  , x(t)(^  ...  X (t) 


^(t) 
^ / pxd 


and 


x(t)=r  X 

pxd  ^ 


.(d-1) 


'J 


I 0 

lAt  I 

IAt^/2! 


0 ! 

lAt  I 


♦ E 

nxd 


(181) 


(182) 


j 


* 


xct)  - x(t^)  T^y(t.t^)  . E 

pxd  pxd 

Note  that  the  state  of  Equation  (180)are  column  vectors  of  dimension 
pxd;  whereas  the  vectors  of  Equation  (182)  are  rectangular  matrices 
of  size  pxd. 


F.  STATE  DYNAfllCS  FOR  CONTINUOUS  POLYNCMIA^  AND  POLYNOMIAL  BASE 
CHANGE.  This  section  shows  the  conventional  state-vector  differential 
equation  and  solution  associated  with  polynomials,  plus  novel  results 
obtained  from  the  time  derivatives  of  a pair  of  oblique  bases  connected 
by  a constant  matrix. 

If  the  d^^  derivative  of  a continuous  polynomial  (monomial  form)  is 
a constant,  that  is 


(d)  (d) 

x(t)  = x (0) 


and  the  state  vector  is 


(183) 


(184) 
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i 


) 

J 


J 


Note  that  the  matrix  F is  nilpotent  index  d,  that  is 


= 0.  (187) 

The  companion-matrix  form  for  a d^^*  order  dynamical  system  with 
state  feedback  term  is  given  as 


and  the  companion  matrix  is 


V^~T 


Clearly  Equation  (185)  holds  for 

For  the  general  case  of  Equation  (188)  one  has 
x(^  = r x(d.>  e^  g(t) 

and  the  solution  in  terns  of  the  fundamental  matrix  1>(t)  is 


(190) 


(191) 


x(^  = ♦ (t) 

tlxd 


x(to]>* 


(t)  e>  g(T)dTj 

• ' d I 


(192) 


"0 


where 


and 


rt 


or 


<t(t)  = e 


x(t)''>=  + 


ft 


^F(t-T)  g(T)dT 


(193) 


(194) 


(195) 


The  companion  matrix  of  Equation  (189)  can  be  expressed  as  the  sun 
of  the  nilpotent  matrix  of  Equation (185)  plus  a dvad 


F = S 


uo 


(196) 
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w ■!  ».■  'jp  gar  » »-  r«e  i 


'fiP  . 


f 


! 

! 

r 

!■ 

!• 

; 


where  shift-up  and  out  matrix  is  given  by  Equations  (31) 
r 1 


The  shift  operator  of  Eouation  (197)  has  the  powers  property  given 

as 


T 


(197) 


(198) 


(199) 


By  the  matrix  exponential  expansion  of  Equation  (1  ) Section  A 
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The  extended  state  vector  is 


or  a d+1  vector.  If  the  vector  and  g(t)  are  knovn  then  there 
are  only  d independent  variables  and  by  liquation  (195)  the  solution 
vect^  is  completely  known  if  t^  initial  state  vector  is  known. 

If  is  known  (for  example:  <^)  and  g(t)  is  assumed  an  unknown 
constat  over  a time  interval,  then  one  has  a (d+1)  dimensional 
state  vector  to  estimate.  As  an  example  a constant  acceleration 
scalar  system  over  a time  span  is  described  by 


(206) 


(207) 


* T fa)  V^t(^ 


By  Equation  (214) 

«■  _ k”! 


3x3  "" 


or  Equation  (217)  in  Equation  (216) 

■ = T (a)  V T (a)  x(^ 


h'here  the  extended  state  dynamics  matrix 


(216) 


(217) 


(218) 


or 

/ * \ 

i X 

1 ...  ! 

' X ' 

1 = x(V^=  F 

' ■ e 

3x3 

3x3 

(219) 

V T (a)  = S, 


(220) 


and  clearly  has  rank  2,  the  rank  of  V. 

TTie  two  dimensional  state  vector  at  time  zero  is  by  Equation  (213) 


x(0)(>>  * 


;^o  *^1 


aj  2a2  0 


(221) 


r 


and  the  solution  to  the  two  dimensional  case  by  Equation  (192)  is 

ft  / 1 -T 


(222) 


dx 


^0  ^1^  + ^2^ 


+ Sa^t 


J 


Note  that  Equation  (219)  is  homogeneous,  while  Equation  (209) 
non-homogeneous . 


is 


The  extended  system  (3x3)  matrix  of  Equation  (219)  has  the  soluti 
x(t)('3>  = e^ou'^x(0)(^ 

' ( ' * '‘out  t £ \ K(o;> 

O I ' 


iit) 

3x3 


x(0)^^ 


By  Equation  (214) 
x(0)(3>  = 


^0  ^1  ^2 


2a^  0 


28^  0 0 


J 


/ \ 

' 'f 1 

0 1 I a-  ! 

X < 


\ “/ 


(223) 


(224) 

(225) 

(226) 


(227) 
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hence  Equation  (227)  in  Equation  (226) 


From  the  above  it  can  be  seen  that  for  a second  order  dynamical  system 
with  unknovim  force,  one  needs  a three  dimensional  state  vector  instead 
of  two  dimensions.  The  generalization  to  higher  derivatives  is  ob- 
vious. 

STATE  DYNAIvllC  EQUATim  CHANGES  DUE  TO  TIME-AXIS  BASE  CtiANGF..  This 
section  derives  some  relations  <}ue  to  time- axis  base  changes.  By 
Equation  (157) 


and 


x(t)''>  = ♦(t.t^)  x(t^> 

-1 

x(t^)  ' = * x(t|> 


(229) 


(230) 


Taking  the  derivative  of  Equation  (229) 


i (t,tj^)  x(tj^)> 


(231) 


and  using  Equation  (230)  in  Equation  (227) 


x(t^ -'('(t.tjj)  4"^(t,tjj)  x(t)N 


(232) 


or 


% “ ‘\o  * * • 

dxd 


(233) 
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By  equation  (159) 


♦ = T^(t)  (tj^)  (234) 

By  liquation  (233) 

* "-'h'  ■ ^uo  ‘ "-'b'  ‘“5) 

= iv") 

By  equation  (152) 

T^(t)  = T^(t)  (256) 

Using  I'.nuation  (25o)  in  l.quation  235) 

= T^(t)  (t^)  . (237) 

The  inverse  of  equation  (234)  is 

(238) 


Using  Equations  (238)  and  (237)  in  liquation  (233) 


which  says  that  the  nilpotent  shift  operator  or  the  state  dynamic  matrix 
is  similar  to  the  base  velocity  matrix  V . 


A time  axis  base  change  by  liquation  (135)  is 


where  by  Equation  (128) 


For  a fixed  ti,  and  a linear  time  axis  scale  factor  of  1 


the  derivative  of  liquation  (240)  with  respect  to  t'  is 


It  is  easily  established  by  differentiation 


and  by  Equation  (22)  Section  I,  one  can  see  that 


Continuous  Time  Base  Change  on  the  State  Vector.  Tlie  variable 
x(t)  can  be  written  as  by  Equation  (240) 

-1  . 

x(t)  = x(t')  =<ti>  = <t' 
or 

x(t')  ^ 

where 

•3>  ■ y"  ■ 

The  derivative  of  Equation  (250)  with  respect  to  the  new  time 
variable  is 


FIGURE  (1) 


Section  5 

DISCREET  "METRIC  >5ATRi:<”  FOR  PROMT,  BACK  AMS  CENTER  OF  SPA?:.  The 
previous  sections  derived  a normalized  metric  matrix  for*  time 

bases  via  integration  of  the  dyadic  product,  namely 


"2-^1 


(1) 


In  dealing  with  discreet  tine  points  on  continuous  functions  one 
normally  replaces  integration  by  finite  or  countably  infinite  sum- 
mations. Consider  the  dyad  at  time  t that  is 

n 


..d-l  ^d-1 

"n  ■ * ■ "n 


and  the  sura  (arbitrarily  chosen  non-normalized) 


The  sununation  of  N+1  rank  one  dxd  dyads  can  be  expressed  instead  of 
a sum  as  a product 


M = T T 
dxd  dx(Ni-l)xd 

Where  the  (N+l)xd  matrix  T is  a column  of  row  vectors 


T 

(N+l)d 


and  the  transpose  is  a row  of  column  vectors, 

= ^0*  ••• 

dx(N+l)  ^ 


For  a time  span  of  discreet  data  points,  the  notation  of  Figure  (1) 
will  be  used  to  generate  the  matrices  commonly  occurring  in  discreet 
least  squares  estimation. 


/i 
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Thft  arbitrary  time  point  t of  Figure  (1)  is  expressed  as 


t = tb  t t 


(6) 


= t + f 
c 


= t^  - f 


where  the  instantanious  continuous  time  point  t is  expressed  as  a function 
of  the  primed  variables,  t",  t",  and  t'".  The  parameters  or  variables 
tb,  t^,  and  tf  reference  the  back,  center  and  front  of  the  span.  It  is 
seen  by  the  figure  that  the  point  at  the  beginning  of  the  span 


b o 


c o 


f o 


+ ih 

07) 

0 

' center  and  front  points 

+ kh 

(8) 

o 

+ Ih 

(9) 

For  a moving  span,  one  develops  recursive  relations  for  i,  k,  and 
1 varying  also.  In  this  section  the  structure  of  the  matrices  for  the 
variables  within  the  span(n,  m,  and  Y)sre  developed. 


The  discreet  analog  of  Equation  (6)  by  using  Equations  (7),(3)  and 
(9)  in  Equation  (6) 


t(i,n)  = t^  + (i+n)  h 


(10) 


• • • 


i = 0,  1,  2, 
n=0,l,2,  . . .,  N=2M 


266 


g w-  J.  - — .‘-w 


t(k,m)  = t + (kim)  h 


t(k,ai)  = h [3+T(k,m)] 


t(i,Y)  = h^[0+T(il,Y)] 


T(i,n)  = (i+n) 


Note  that  at  the  back  of  the  span  that  is  t=t,  by  Equation  (13), (14) 
and  (15) 


t(i,o)  = h^  B +i] 

= t(k,-M)  = h^[S+k-M] 

= t(!l,2M)  = h^[S+S.-2M] 
and  the  above  equivalence  relations  imply 


i = k-M  = )l-2M 
at  the  center  of  the  span 


t(i,M)  = h^C3+(i,iO] 

= t(k,o)  = h^[3+k] 

= t(  z,:o  = h^IB  + t-?.?] 

at  the  front  of  the  span  one  has 

t(i,2H)  = h [3+i+2M] 
o 

= t(k,:!)  = h^C3+k+M] 

= t(Z,s)  = h^[3+ZJ 

The  relationship  between  the  width  of  the  span  W occurring  in  th 
.natrices  of  Section  (4  ) for  the  continuous  case  and  the  number  of 
points  in  the  span  of  Figure  (1)  is 


f 

Idt  = t^-t  =W=NAt 


I 


grrj  rn^v 


^ ^Ou  I 

The  inverse  transformations  and  the  ones  of  prime  interest  here  are 
obtained  as  the  discrete  analog  of  Equations  (135)  Section  C4  ).  By 
Equation  (20)  using  the  notation. 


<^n)  = (l,(i+.0  ,(i+n)^.  • • (i+n)'"^  *)  = <^i,n) 


(3;) 


•./s  ootain 


^Ti.n)  =<^i.r.)  3-"(h^) 


-t 


-2t 


-t. 

3t* 


o 

"o 


(37) 


?,l30  by  ZraatLo:-.  ( .36  ) and  Equation  (17)  the  left  hand  side  of  Equation 

(37)  is 


0 

0 

0 


4i' 

<• 

5i‘ 

4i 


(33) 
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(39) 


BEsr  ysw.;:’.::;  copy 


= <n  Vi) 


,,  2 3 ...  d-1. 

(1,  a,  n , n , • , n ) 


(40) 


Equations  (21)  and  (22)  havs  the  same  right  hand  tenrs  as  Equation  (37); 
however,  the  left  hand  terms  differ.  The  left  hand  term  by  Equation 
(21)  and  Equation  ( 18  ) is 


where 

(1,  ±m,  ±m^,  •••)  (42) 

and  the  transformation  to  front  of  the  span  by  Equation  (22)  is 


The  matrix  N*  is 

dXi'^+1 


BEST  AV/i!'iEi:  COPY 


[_C  1 2<i-l  3^'^ 

If  we  partition  N as  shown  below 

= r e(^,  1 

dxK+1  L 1 J 


w..ere  the  partitioning  of  the  matrix  C into  its  row  space  yields  row 
vectors  whose  coordinates  are  powers  of  the  first  N natural  numbers 

LilSti  is  * 


(1,  1, 

1. 

• • • 

1) 

(1,  2, 

3, 

t • • 

N) 

(1,  2^ 

,2 
- > 

• • • 

CM 

(1, 
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and 


T 
C C 


dxd 


^51  MfAlu-S’ 

i COPY 

“n 

<iC> 

■ 

• • <!<:“>' 

<1> 

<c^ 

<’i> 

<^l> 

1 

i ' 

<?>> 

1 

j 

1 

<j^-> 

• • 

(S8) 


note  the  properties 


or  the  sum  of  the  squares  of  the  first  N'  natural  numbers,  also 


<Ay  = 1 > 2^^ . 3*^ . 


+ N 


,d 


(60) 


is  the  sum  of  the  d^’'  powers  of  tlie  first  N natural  numbers. 
Adding  liquation  (38)  to  Equation  (56) 


T 

N N = 


N+1  <1^ 

<^1 ^ ^ 


(f>l) 
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- ' ■ 


» ? 


( 


1 


*> 


:-  arTaii-if- 


The  matrix 


BEST  AVASLABII  COPY 


1 0 0 


(62) 


contributed  to  the  first  row  first  column  term  in  Equation  (61),  and 
Equation  (61)  is  clearly  a llankel -matrix.  The  sums  of  the  powers  of  the 
natural  numbers  are  given  in  Appendix  ( c). 


Tlie  discreet  analog  of  tlie  metric-matrix  of  Equation  (145)  sec  (4)  is 
Equation  (41) 


1 

- I 

W 


T(k 


m=-M 


m) 


(63) 


1 T 

= - T‘(k) 
w u 


I ^<< 


T (k) 
o'-  ■' 


(64) 


The  sum  of  dyads  of  Equation  (04)  can  be  written  as 


and  the  linear  convolution  matrix  is 


with  the  property 


Transposing  Equation  (67) 


M 

(2f  rl)xd 


and  the  Gratnmian  is 


m’^m  = c'^(-i)  c(-i)  + c'^'c 


The  Ilankel  matrix  c‘ (-1)  C(-l)  has  altematii 


(76) 


with  alternating  left-slant  diagonals  being  zero.  Once  again  is  a 
Hankel  matrix.  Only  even-powers  of  the  natural  numbers  occur.  Compare 
this  matrix  with  continuous  one  of  Equation  (145)  Section  (4  ). 

The  transformation  to  the  front  of  the  span  with  the  running  index 
y running  backwards  by  Equation  (146)  Section  (4  ) has  the  discrete  analog 
by  Equation  (43) 

(77) 


The  summation  term  of  Equation  (77)  is 


dx(2M+l)xd 


(78) 


The  matrix  T is  by  Equation  (44) 


282 


Transposing  Equation  (HO) 


1 i*  ‘ ^ ^ ^ PniM/ 


r = c 

dx(N+l)  . 


;'[(-i),  =()> 


and  the  Grammian  is 


r'^r  = c'Vi)Cj^(-i) 


+ c(^^^  <^e 


Tlie  Craiiimian 


cJ'c-DCj-i) 


-<i^  <1^ 


<.c> 

<ci> 


(-l)“<lc‘'">|(85) 


<c> 

<lc^^ 

<c!> 


-<^c>  <^C~^ 

<^ci>  -<(c^> 

-<C^^ 


Note  the  alternating  signs  on  the  left  diagonals  of  the  ilankel  matrix 
of  Equation  (86). 


Summarizing  the  three  Crawmian  matrices  for  spans  with  indices  over 
the  natural  numbers  running  from  back,  center  and  front  of  the  spans  are 
by  Equations  (61),  (76)  ajid  (86) 


N+l 

<;<> 

<i»l> 

<v> 

<3Ni> 

<»i> 

. • • 

(J?7) 


For  3x3  matrices  (or  second  degree  polynomials) 
sectioi;  (C)  for  suii:s  of  j)owers  we  iiave 


p 

SjCw) 

S^C.V) 

where  by  ( c - 3 thru  8) 


s^OO 

S^CN) 

S3(N) 

S3(N) 

340'-) 

using  the  notation  of 


(9^) 


P 

I" 


(91) 
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and  for  front  span  case 


w 

p 

-Sj (N) 

S2  (N) 

-S^ (N) 

S^(N) 

-S3(N) 

S2  (W) 

-S3(N) 

54  (N) 

For  a second  degree  polynomial  and  ''’’^^=7  points  - we  have 

Sj(N)  * ^(6)  = 21 


^2^^)  = -(03(13)=  1(1:,)=^ 


.S,(.N’)  = (36)  = 49(9)  = 441 


S4(N)  = jQ  (6) (13) (125)  = 2275 


(“^S)  = 7(2)  = 14 


S4(M)  - 

7(70) 

5 

490 

5 

= 98 

i\  iM  = 

7 

21 

01/6 

21 

01/6 

441 

yi/6 

441 

2275 

(100) 

(103) 

(102) 


(105) 


I 


1 


TuNin};  the  dyadic  product 


and 


= I(±l) 


L(|uation  CH'u)  by  (111)  and  C112) 
■pC^  = I(il)  \><n^  I(±l) 


Suiiiminjj  all  dyads 


I n><n 
and  invcrtinjj  tlie  .natrix 


P I(±l) 


^ I ^ = i(ii)  ^ I y><p  j 


(Iin) 


nil) 


(112) 


(113) 

(114) 


(113) 


(116) 
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r ' r 


T 

MM  = 


N+1 


i 0 

I 

1 

i N(N'+l)(N+2) 


and  the  inverse  is 


T -1 
(.'!  f!) 


N(N+l)(N+2) 

n 


(iN'+3) 


-15 


0n"-1)(N'+3) 


12 


(119) 


N(N+1) (N+2) 

n 


N(N+1)  (N'+2)  (3N'^+6M-4) 
TTo 


X(N+1) (N+2) 


(120) 


-15 


CN‘-l)(N+3) 


isn 


N (N+2)(N+3) (N^-1) 


.] 


The  matrix  for  front  span  of  Equation  (92)  for  N+I  points  in  the  span 


IS : 


r^r  = 


N+1 


-:J(\'+1) 


-N(N+1) 

2 


N(N+1)(2N'+1)  -N^(N+1)^ 


(121) 


N(.\+l)  (2N+1) 
6 


N(N+1)(2N+1)  -12(n+i)2 


N (N+1)(2N+1)(3.\‘-+3N-1) 
30 
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and  the  inverse  of  121  using  liquation  (116)  and  Equation  (IIS)  is 


T -1 

(r‘r) 


3X^+3, M+2 

12N+6 

10 

12X+6 

4(2N+1) (8N-3) 

60 

.'^-D 

10 

bO 

60 

N-1 

mTx 

(122) 


where 


(';+l)(.N+  )(N+3) 

Mote  t!u:  sign  reversals  in  liquation  (IIS)  and  (12?)  in  the  inverse  natrices. 

The  nrammian  inverse  matrices  and  their  psuedo  inverses  will  be  used  in 
Later  sectioiis. 

By  Equations  (35)  and  (38)  for  the  d=3  case  and  back  to  front  of  span 
indices  we  have 


<t(i.n)  = T^(i)T^(6)D(h^)  = <nT 


and  for  n=0,l,2, • • • ,N 


<t(i,0) 
<t(i,2) 

[<t(i,N)_ 
and  the  transpose  is 


T = N T(i.h  ) 
(N+1)X3  (N+1)X3  3x3 


(123) 


(124) 
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r ^ T 


...  -p 

T = T (i,h  JN 
o 


(125) 


and  the  discrete  metric  is 


T^T  = T^(i,h  ).\'^NT(i,h  ) 
3X3  ° ° 


(125) 


where  the  purely  "number  theoretic"  metric  xTn  is  given  by  Equation  (61) 
or  Equation  (119)  for  the  3x3  case. 

The  inverse  of  the  discrete  metric  of  Equation  (126)  is 


(tTt)-I  ^ 

where  the  inverse  (nTn)-I  is  given  by  Equation  (118) 


(127) 


For  the  center  of  span  case  we  have  by  Equation  (35) , Equation  (41) 
and  Equation  (42) 


T = M 
(N+1)X3  (:n>1)X3 


<J(k.m)  = <JiT^(k)T^(3)D(h^) 

and  packagewise  for  the  points  over  the  span 
<t(k.-M) 

<t(k.-l) 

<t(k.O) 

<t(k.l) 

L<t(k.M)J 

and  the  metric  is 


(128) 


\(k)T^(6)D(h^)  = Nrr(k.h^)  (129) 
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(130) 


T^T  = T’^(k,h  )M^wr(k,h  ) (130) 

3x3  ° ° 

where  the  "number-theoretic"  metric  MTIi  is  given  by  Equation  (76),  and  the 
inverse  is 


(tTt)-I  ^ T'\k,h^)(M'^M)"^T‘’^(k,hjj) 


(131) 


The  front  of  span  to  back  case  by  Equation  (35)  and  Equation  (43)  is 


<t(t.Y)  = <Yty(A)t^(6)D(h^) 
<^(A,y)  = <YT(t,h^) 

<(  = (l.-Y.Y^-Y^•••) 


and  for 


Y = 0,1.2,---,N 


we  have 


^(A,0)]=  T = r T (£)T  (0)D(h^) 
(N+1)X3  (N+1)X3  o 

4(Jl,l) 

<t(Jl.2) 


4(^.y) 


<J(il,N) 


(N+1)X3  (N+1)X3 


r T(t,hJ 


(132) 


(133) 


(134) 


(135) 


(136) 


where  r is  given  by  Equation  (79) . 

The  metric  is 

(t'^T)  = T'^(Jl.h^)r'^rTOl,h^)  (137) 

and  the  inverse  is 

T -2  -IT  -1  -T 

(T*T)  = T "(r*r)  ^T  (138) 

Where  the  metric  r^r  and  its  inverse  are  given  by  Equation  (86)  or 
Equation  (121)  and  Equation  123). 

DISCRETE  "METRIC-MATRIX"  FOR  FORWARD  AND  BACKWAEU)  EXPONENTIALLY 
WEIGHTED  MONOMIAL  BASE~  This  section  develops  the  discrete  metric-matrix 
for  the  base  vectors  which  when  "Gram-Schmitted"  yield  the  Laguerre  base 
over  the  interval  (0,“>)  on  discrete  point  sets.  The  following  section 
will  derive  the  discrete  Laguaerre  polynomials  utilizing  these  matrices. 

Forward  Exponential  Weight  Case.  The  back-to-front  case  will  be  con- 
sidered first  with  the  index  N going  to®.  By  Equation  (30),  Section 
( 2) 


and  by  Equation  (13) 

t(i,n)  = h^[6+T(i,n)]  (140) 

or  by  Equation  (17)  in  Equation  (140) 

t(i,n)  = h^[B+i+n]  (141) 

and  Equation  (141)  and  used  in  the  exponential 

at  aho[B-i-i-»n]  ahpn  aho(B-t-i) 
e^=e  ^ =e^e  ^ (142) 


or 


and 


N = Nw 

(N+1)  (N+l)xd  (N+l)xd 


Form  the  metric 


WN 


T T 

N N = N 

dx(N+l)  (N+l)Xd 

aM 


The  elements  of  Equation  (152)  are  by  Equation  (50) 


1 0 0 

1 1 1 

1 2 2' 

1 3 3' 


1 N N 


^d-1 

,d-l 


N 


d-1 


= "*‘[■>0  • '^1  ■ 


and  the  metric  of  Equation  (153)  is 

W 


n’^wn  = 


<^l)nj 


n(N+^^,  n(N+^j,* 


or 


The  i,  jbh  elements  of  Euqation  (155)  is 

m^j  ='^^)n  W n(N+^  = <^dig^^>j  w(N+^ 

m^^j  = 

i+j 


(152) 


(153) 


(154) 


(155) 


(156) 


(157) 
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where 


and  the  counting  number  vector  of  dimension  N is 


By  Equation  (158)  in  Equation  (156) 


where  i, j=0,l,2* • 'd-l  and 
O<0  = u)<l 

we  have  for  i,j=0,l,2 


1 

1-e 


" 1 

I ce'=.-!-^ 

c=0  (1-6) 

I = eiilli 

c=0  (1-6) 


0^6^^ 


c=0 


9(l-t-46+6^) 

(1-6)^ 


I = (U119-Hl9^^-6^ 

c=0  (1-9)^ 


(158) 

(159) 

(160) 

(161) 

(162) 

(163) 

(164) 

(165) 

(166) 

(167) 
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iiKiiiiiiilii 


T 


and  the  3*3  metric  matrix  is  (the  non-dimensionalized  portion) 

1 


M 


TT0 


1 

1-0 


0 


(i-e)‘ 


0(i>e) 

La-e)^ 


(i-e)‘ 

0(i>e) 


e(i-*-04-t-0  ) 

(i-e)"* 


0(l-f0) 

(i-e)^ 

0(l-»-40-t-0^) 

(i-e)"* 

0(l*110fll0^*0^) 

(1-e)^ 


(168) 


Backward  Exponential -Weight  Case.  The  front  of  time-span  to  back  in  the 
limit  as  N->«>  case  of  Equation  (132)  to  Equation  (137)  will  be  developed. 

By  Equation  (15)  and  Equation  (19) 


t(t,Y)  = h^  [B+J'.-y] 


= h^  (B+t)  - h^Y 


(169) 

(170) 


By  Equation  (23)  in  Appendix  D we  see  that  for  the  negative  infinity 
limit  we  need  a weight  factor  e^^  where  a>0,  hence  Equation  (139)  becomes 

<fe  =<^te  = (l,t.t^t^...)  e®^/^  (171) 

Using  Equation  (170)  in  the  exponential  factor  of  Equation  (171) 
at(jl,Y)  ah^(6+ii)  -ah^Y 

e ^ = e ^ e ^ (172) 


-at(Jl,Y)  ao  Y 

2 2,2 

e =e  V 


(173) 


where 


go 
2 

e = e 


ah  (8+t) 
o 


(174) 


and 
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,h  2 

= e 

By  Equation  (173)  in  Equation  (171)  and  Equation  (132) 


(175) 


<^=6^  ^^<jT^(Jl)T^(6)D(h^) 


where  by  Equation  (134) 


^ 2 3 4 . ,,d-l  d-1  , 

<^=  (1,-Y,Y  ,-Y  .Y  ,-••(-1)  Y ) 


or  packagewise  by  Equation  (135) 


rT(Jl,h^) 

(N+l)xd 

and  the  weighted  metric  of  Equation  (137)  becomes 

t'^T  = T^(Jl,ho)  r'^WrT(Jl,ho)e“° 
e e 

The  r matrix  is  given  by  Equation  (79)  as 


(176) 


(177) 


(178) 


(179) 


r = 1 -N  N"  -N"  (-1)'^‘^(N)‘^"^ 

(N+l)Xd  2 3 d-1  d-1 

1 -(N-1)  (N-l)'^  -(N-1)  (-1)  (N-1) 


(180) 


1 -1 


1 0 


Equation  (180)  can  be  written  as  Equation  (154) 


r = n(n^,  -L  n(N^,  • • • (-l)*^"^!^ 

J+l)xd  V (N^L)(N+1)  ^ 


(181) 
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or  the  metric  is 


T 

r r = 

w w 

dxd 


0^ 

<^L 

1^ 


d-1 


The  3^3  matrix  case  becomes  as  N->” 


W 


•0  12  d-1-* 


C182) 


M (1)  = 


1 

1-4* 


-<l* 


■4* 


(1-4*)' 


(1-4*) 

4*(l'*‘’l*) 

(1-4*)^ 


4)(l-^4*) 

(l-'i*)^ 

2 

-4*(l*44*-*-’i*  ) 
(l-'l*)'' 


2 2 3 

(1+4;)  -4*(1-*-44*-*-4'  ) 4*(l-*-ll'i<-*-ll’i^  •^’1'  ) 

(1-4*)'^  d-'i')^ 


(183) 


(I-*!*)" 

which  is  the  same  as  Equation  (168)  except  for  alternating  signs,  and 
-ah 


0<4*  = e " <1 

By  Equation  (147)  we  see  that 


(184) 


4*  = 0 


(185) 


ORTHOGONAL  POLYNOMIALS  OVER  DISCRETE  POINT  SETS  FIvONT,  CENTRAL,  AND 
BACK;  GRAM,  LEGENDRE  AND  LAGUARRE.  Morrison  says  that  one  approach  to 
obtaining  the  form  of  the  polynomials  so  defined  would  be  to  use  a 
Schmidt  orthogonalization  procedure ...  as  many  of  the  polynomials  as  we 
have  energy  for,  each  to  within  an  unspecified  constant.  He  says  the 
drawback  to  the  above  method  is  that  the  general  form  of  the  polynomials 
is  not  then  obtained.  Morrison  derives  the  discrete  polynomials  by 
applying  summation  by  parts.  He  says  he  has  extended  Hildebrand's 
approach  for  obtaining  the  discrete  Gram  polynomials  to  obtain  the  dis- 
crete Lengendre  and  Laguerre  polynomials.  Morrison  says  that  Milne  has 
an  alternate  and  extremely  elegant  derivation  of  the  discrete  Lengendre 
polynomials.  In  Erdelyea  (page  222)  one  finds  also  the  derivation  via 
summation  by  parts  with  a reference  to  an  alternate  route  via  the  methods 
of  generating  functions.  The  applications  of  Laguarre  polynomials  to 
trajectory  estimation  problems  in  Reference  (16)  by  Brown  use  matrices 
which  though  not  called  as  such  is  the  metric  matrix  of  Equation  (183). 
Since  I have  not  found  references  deriving  the  orthogonal  polynomials  via 
the  different  variations  of  Gram-Schmidt  procedures  they  are  developed 
here  for  the  3X3  case,  the  case  most  commonly  applied  in  trajectory  esti- 
mation corresponding  to  constant  accelerations  over  data  spans.  Also 
many  of  the  submatrices  inverted  here-in  will  be  applied  later  to  the 
exponentially  weighted  filter  equations.  And  finally  with  respect  to  the 
simple  minded  vector  space  concepts  thus  far  develcped  at  this  stage  of 
the  report ; the  Gram-Schmidt  procedure  is  the  most  natural  way  to  develop 
said  polynomials. 

Three  cases  of  the  discrete  monomial  base  will  be  developed: 

1.  Back  to  front  of  span, 

2.  Mid-point  span  or  central,  and 

3.  Front-to-back  of  span. 

One  additional  case  will  be  developed  for  the  exponential  weighting 
from  front-to-back  as  the  back  point  of  span  goes  to  negative  infinity. 
This  later  case  is  the  case  of  smoothing  over  all  data  from  real-time 
(front)  to  back. 

The  Gram-Schmidt  procedure  will  be  applied  first  to  the  matrices  over 
the  integers,  N,  M and  T and  the  Laguarre  case;  and  then  to  derive  the 
classical  polynomials.  The  necessary  transformations  on  these  orthogonal 
polynomials  to  take  care  of  the  matrices  T(iho)  T(k,ho)  and  T(Jl,ho)  will 
be  done  in  a separate  section. 


T 


Orthogonal  Polynomials  With  Respect  to  Summation  Over  Discrete  Point 
Sets  Indexed  from  Back-to-Front  of  Span  for  Matrix  N.  Consider  the 
second  degree  polynomial  case  generating  the  N matrix  of  Equation  (50) 


^ <n  n)>  |(N+1) 

0 1 

hence 


The  third  Gram-Schmidt  vector  with  first  coordinate  constrained  to 
unity  is 


The  2^2  submatrix  by  Equation  (90)  is 


Sj(N)  S2(N)7  = deTC) 


S2(N)  S3(N) 


-S2(N)  SjCN) 


where 


detO  = Sj(N)  SjCN)  -S^CN) 


Using  Equation  (197)  and  Equation  (198)  in  Equation  (196) 


li^  = 


S3(N)  Sq(N) 


Sq(N) 


-S2(N)S^(N) 

+S^(N) 


1 

detO 


(197) 


(198) 


(199) 


Ul2  = C-1) 


(N+1)  ^ (N+1)^-  I (N+1)  I (N+1)  (2N+1) 
2 2 

N N _ A (2N+1)2 


Cancelling  terms  and  collecting  one  obtains 


(200) 


"12  ■ ■ N-1 


(201) 


and  in  a similar  manner 


22  ■ N(N-l) 


(202) 


n^, 

2 Lo  1 2, 


(203) 


6 

N(N-l) 


The  first  three  Gram-Schmidt  vectors  by  Equation  (188) , Equation  (192) 
and  Equation  (203)  in  package  form  are 


, g(^^,  g(N^>  = ^ 1 1 1 

*^1  ^2  0 12  , . 

J L J „ -2  -6 


N N-1 


(204) 


0 0 


N(N-l) 


G(N)  = N Bg(N) 
(N+1)X3  (N+1)X3  3x3 


(205) 


where 


B (N)  = 1 1 1 

^ N N-1 


(206) 


0 0 


N(N-l) 


If  one  now  partitions  Equation  (205)  into  its  row  space 


(1  0 0) 


(207) 


(1  1 1) 


(1,2,2")  Bg(N) 


11 

<$g 


d.n.n") 


(1,N,N") 


and  equating  the  Cm+l)^^  element 


<1^  = (l.n,n^ 


(208) 


0 -2  -1- 
N N-1 


We  obtain  the  first  three  of  the  general  form  for  what  Milne  calls  the 
discrete  Lengendre  polynomials.  The  first  six  are  given  on  page  267  of 
reference  [ ] as  (for  n=0,l,2, • • -N) 


^ ■ N 


, 6n  . 6n(n-l) 
■ N N(N-l) 


g fn)  - 1 - + 30"(n-l)  . 20n(n-l)(n-2) 

^ N N(N-l)  N(N-l)(N-2) 


xT(n)  = 1- 


20n  90n(n-l)  140n(n-l) Cn-2} 

N "■  N(N-l)  ■ N(N-l)(N-2) 


(209) 


jnfn-1 1 (n-i 


N(N-l) CN-2) (N-3) 

, 30n  . 210n(n-l)  560nCn-l) (n-2) 

^ ■ N N(N-l)  ■ NCN-2)(N-1) 

630n(n-l) (n-2) Cn-3) 


N(N-l) (N-2) (N-3) 


inin-1) in-i 


N (N-1) (N-2) (N-3) (N-4) 


The  general  term  is 


(210) 


where 


6 = 0.1,2,'-',d-l 
the  degree  of  the  polynomial  and 

n^^^  = n(n-l) (n-2) • • • (n-e+1) 

is  the  backward  factoral  function  given  in  Appendix  (B).  Milne  utilizes 
the  Newton  polynomials  in  his  derivations. 

The  general  term  for  the  elements  of  the  diagonal  metric  matrix  G^G 
is  given  on  page  (268)  of  Milne  as 


N 


y g2  , . ^ (N^6nj  (5^N). 
L St  rgi 

n=0  (26+1)  N*- 


(6) 


(26+1) 

and  for  the  first  three 


and 


or 


N 


L ®0,N 


Cn)  = N + L 


n=0 

N 


L 8i  m(^J  “ (ll 

n=0  (2+1)  n'-^-’ 


3N 


y 2 _ (N+2  + l)(2+N). 

L St  (2) 

n=0  (4+1) 


(2) 


y 2 , . _ (N+3)(N+2)(N:^ 

Jiq  ■ 5N{N-1) 


(211) 


- (N+2)  (N+1)^^^  ^ CN+2)  (N+1)  ^ (N+2)  (N+1) 


(212) 


(213) 


These  diagonal  metric  elements  can  also  be  derived  via  Equation  (188) 
Equation  (192)  and  Equation  (203).  By  Equation  (188) 


N + 1 


"> 


By  Equation  (192) 


(1.-  f) 

N+l 

N(N+1)  -] 

2 

l' 

N(N+1) 

L2 

N(N+1)(2N+1) 

6 J 

2 

; N. 

and  the  square  of  the  norm  of  the  vector  is  likewise  obtained 
the  discrete  metric-matrix 


M = G^(N)  G(N) 

3X(N+1)  (N+1)X3 


N+1 

0 


0 

(N»2) (Nf 1) 
3N 


0 

0 


(N^3)  (N-t-2)  (I 
N5(N-i; 


The  first  three  ortho-normal  discrete  Legendre  vectors  are 


G(N) 

(N*1)X3 


S(N)  = N 
(N+1)X3  (N+1)X3 


M"^  = N 
8 gg 


Bg(N) 


where 


Bg(N)  = Bg(N) 


By  Equation  (205) 

G(N)  = N B (N) 

(N*1)X3  (N+1)X3  I 


(214) 

(215) 

yielding 

- 

(2 

!ia 

(217) 

(218) 

(219) 


(222) 


and  inverting 

(N^N)  = B M"^  (223) 

g gg  g 

and  for  the  3^3  case  by  Equation  (206)  and  Equation  (216)  in  Equation 
(223) 


T = 

(N^N) 

3 

(N+1) (N+2) (N+3) 

3N^+3N+2 

-(12N+6) 

10 

-(12N+6) 

4(2N+l)(8N-3) 

N(N-1) 

-60 

N-1 

.10 

-60 

60 

N-1) 

TinrJ 

(224) 


The  inverse  of  the  matrix  Bg(N)  can  be  obtained  via  Equation  (395)  of 
Section  ( i ) as 

-1  -ITT 

B ^ = D B N N (225) 

g g g 

Orthogonal  Polynomials  With  Respect  to  Summation  Over  Discrete  Point 
Sets  Indexed  From  Midpoint  of  Span.  The  matrix  of  integers  of  Equation 
(129)  M is  given  by  Equation  (66)  for  the  second-degree  polynomial  case 
as 


'W 


► I 


M 

(2M+1)x3 


-M 

-2 

-1 

0 

1 

2 

(M-1) 

M 


M 

(M-l)‘ 

1 

0 

1 


M 


(M-l)‘ 

2 


(226) 


The  vector  of  the  row  space  is  given  by  Equation  (42)  as 

^)m  = (l.trn.m^) 
for  m=0, 1 , 2, • • -M. 

The  metric  is  given  by  Equation  (119)  as  a function  of  N=2M  as 


(227) 


T 

m'm  = 

3X3 


N+1 

; 

0 


NfN-t-1)  (N-t-2) 
12 


N(N-i-l)(N*2) 

12 


N(N+1)  (N+2) 
12 


NCN+1)  (N+2)  (3N'‘+6N-4) 
240 


(228) 


or  as  a function  of  M as 
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Clearly  by  Equation  (228) 


^+l)in  in(N+^,  m(N+^,  m(N+^  = Pm 

0^  ^ 


0 


1^ 

<^): 


The  following  vectors  are  perpendicular  to  each  other 

m(N^^  = ^^l)m  m(N^^=  0 

^ ^ 1^  ^ 


0 0 
”21  0 ”22 


(236) 


(237) 


first 


Since  the  second  vector  of  Equation  (228)  is  perpendicular  to  the 


g>=  ra> 
1 1 


(238) 


(239) 


If  we  attempt  to  constrain  the  first  coordinate  to  unity  of  the  next 
vector  we  obtain 


= M 


(240) 


with  the  orthogonal  constraint 


or 


’4' 

II 

0 0 

II 

N+l  0 

N(N+l)(N+2)' 

12 

’l  ' 

0 

2 

N(N  l)(N+2) 

0 

^1 

4 

L 12 

> 

. 1- 

(241) 


(7) 


N(N-i-l)  (N-t-2)| 


N(N-t-l)  (N+2) 


12 


12 

0 


C: 


(242) 


and  by  analogy  to  Equation  (235)  we  see  by  Equation  (242)  that  we  cannot 
solve  for  the  two  unknowns.  By  Equation  (237)  we  see  that  the  vector 
1^2  is  perpendicular  to  m^i,  hence  by  Equation  (238)  for  the  ^2  vector 
to  be  perpendicular  to  the  previous  two  ^o.  ^1>  we  must  have  ^2  ii®  i^ 
the  space  spanned  by  1^0  i^2- 


: (N^^  = i^,  ^ 

^ Lo  1 2„ 


L^2J 


(243) 


The  previous  observations  are  not  necessary  if  we  proceed  with  the 
Gram-Schmidt  process  with  the  main  diagonal  unity  constants,  or 

g(N^  = M I A,  I (244) 

'^2 


1 

I-  -I 


or 


0 

< 
l-  !-• 


*>’(S) 


(245) 


i 


]| 


J: 
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Using  Equation  (249)  in  Equation  (257) 


M B (N) 


(N+1)X3  (N+1)x3 


where 


B^(N)  = Bg(N)  (G^G)'^ 


or 


B^(N)  = 


m. 


-NfN^2)/lM 


% » »»  e\.y 


12  N(N+1)  (N+2)  (N‘-+2N-3 

° /N(N+1) (N+2)  ° 

0 0 


/ISO 


N(N+1)  (N+2XN''+2N-3  ) 


or  in  terms  of  the  number  of  points  in  the  span  Wp=2N+l 


(W  ) = 
s^  p'^ 


_1 

P 


(W^-l)(W^-4) 
P P P 


W (W^-1) 
P P 


•w  (W^-1) (W^-4) 
P P P 


The  inverse  of  the  discrete  midpoint  metric  can  be  obtained  via 
Equation  (346),  Section  ( 1 ) as 


(M^M)'^  = B (N)  B^(N) 

3x3  ® ® 
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or  for  the  3^3  case 


3(3N^+6N-4) 


12 

N(N+1) {N+2) 


(N  -1)  (N+3) 


(263) 


(N‘-1)(N+3) 


N(N+2)(N+3)(N  -1) 


( 1) 


In  a similar  manner  the  inverse  of  by  Equation  (358),  Section 


-1  T T 

B = B*  (MM) 
s s 


(264) 


In  a similar  manner  one  can  obtain  the  Gram-Schmidt  as  the  front  to  back 
span  case. 

Orthogonal  Polynomials  With  Respect  to  Summation  Over  Discrete  Point 
Sets  Indexed  From  Front  to  Back  of  Span  for  Matrix  r.  The  metric  is  given 
for  the  3x3  case  by  Equation  (121)  and  the  first  coordinates  will  be  taken 
as  unity,  hence 


= y(N^ 


g(N^  = rY(I^,  Y(^ 
1 '0  1_ 


and  the  orthogonal  constraint  is 


<^1)y1  g(l^  = 

0 0 \o/ 

<^1)Y 


(265) 


(266) 


tBEEdStaK 


observe  by  analogy  with  Equation  (196)  and  Equation  (197)  that 


The  inverse  of  the  metric  matrix  is  by  Equation  (34^,  Section  (1  ) 


T -1  T -1  T 

(r*r)  = Bg  (G*G) 


and  is  for  the  3^3  case 


T -1 

(r  r)  = go 

3N^+3N+2 

12N+6 

10 

12N+6 

4(2N+1) (8N-3) 
N(N-l) 

60 

N-1 

10 

60 

60 

N-1 

N(N-l)  J 

where 

3 

“ (N+1)  (N+2) (N+3) 


(278) 


(279) 


(280) 


Compare  Equation  (279)  with  Equation  (224)  and  note  the  only  differ- 
ence is  some  negative  signs;  now  compare  the  metrics  of  Equation  (121) 
with  the  metric  of  Equation  (187) , and  again  note  the  differences  of  signs 
in  the  same  row  and  column  positions. 


Orthogonal  Polynomials  for  Exponentialy  Weighted  Polynomials  Over 
Discrete  Time  Points  from  Front  to  Back  of  Span.  The  non-dimensionalized 
time  points  generate  the  weighted  vectors  of  Equation  (181)  as 


(N+l)x3 


W 


(N+1) (N+1) 


-Ln(N+ 


(281) 


(282) 


where  the  corresponding  3^3  metric  is  given  by  Equation  (183)  on  terms  of 
e as 


r 

(N+1)X3 


■ 1 
1-9 

e 


0 J 


and  the  square  of  the  norm  is 


4 


(1.^.0) 


T 

r r 
w w 


1-0 

0 


1 

0(1-0)^ 


0 


The  third  Gram-Schmidt  vector  is 


r 

(N+1)x3 


1 


2 


and  the  orthogonal  constraint 


L 1 J 
or 


where 

i j 


(289) 


(290) 


(291) 


(292) 


(293) 


(294) 


325 


t 


By  the  metric  matrix  of  Equation  (283) 


-e (l-t-9) 

(1-0)^  (1-0)^ 


0 -(l-t-40-t-0‘ 

(1-0)^  (l-0)'‘ 


and  Equation  (295)  in  Equation  (293) 


(1-e)^ 

20^ 


(1+40+0^)  -(1+0)  (1-0)  (295) 


-(l+e)(l-0)  -(1-0)' 


^(2>  = 


(e-1)^ 

202 


(296) 


Using  Equation  (296)  in  Equation  (291) 


[(N+^  « 

^ (N+ 


(N+1)X3 


(297) 


L J 

Packaging  the  Gram-Schmidt  vectors  of  Equation  (284) , Equation  (289) 
and  Equation  (297) 

G = Tw  B (298) 

(N+1)X3  (N+1)X3  ® 

where 


-(9-1)  -(9-l)(3e+l) 

2 

9 26 

0 

<«k  ^ 


Orthogonal  Polynomials  for  Exponential  Weight  Over  Discrete  Time  Points 


from  Back  to  Front  of  Span 4 The  non-dimensionalized  time  points  generates 
the  weighted  vectors  of  Equation  (152)  and  Equation  (50)  as 


(N+l)x3  (N+1)(N+1) 


INN 


with  the  3x3  metric  given  by  Equation  (168)  as 


(300) 


‘tt9  1-9 


(1-9)' 


6(1+9) 

(1-9)^ 


(301) 


9 6(1+9) 

(1-6)^  (1-6)^ 


9 (1+46+9  ) 
(1-6)*^ 


6(1+9)  9(1+49+9  ) 9(1+119+119  +6  ) 


(1-9)'"  (1-9) 


(1-9)' 


The  G-S  procedure  with  respect  to  the  metric  of  Equation  (301)  yields 


G = N„  B 
W g 

(N+l)x3  (N+l)(N+lx3 


(302) 


where 


I 


1 L 


(303) 


.(e-l)  -(9-l)(39+l) 


0 0 


(9-1)' 


Relations  of  These  "Discrete  Laguerre  Polynomials"  with  Those  in  the 
Literature.  Morrison  in  reference  ( 61  ) derives  the  discrete  Laguerre 
polynomials  (his  terminology)  via  summation  by  parts  and  refers  the 
interested  reader  to  Gottlieb's  paper  (reference  35  ).  Gottlieb  refer  to 
polynomials  of  the  "Laguerre  Type"  and  gives  the  formula 


I In)  = I 

0 ^ e e 

e=0 


(304) 


where  6=0,  1,  2,  ...  d-1  is  the  degree  of  the  polynomial  and  n = 0,  1,  2, 

3,  ...N. 

If  we  make  the  substitution  of  Equation  (147) 


9 = e 


the  terra  1-e^  of  Equation  (304)  is 


1 _ = 1 - i 

9 9 


(305) 


(306) 


and  using  Equation  (306)  in  Equation  (304)  we  obtain  the  expression  used 
by  Morrison  reference  ( 61 ) page  (65)  as 


(307) 


The  first  three  of  these  polynomials  are 


^^(n)  = 9^ 


(308) 


'i(-)  = e I 

e=0 


(309) 


(310) 


and 


l^in)  = e[l+(^)n] 


^l(n)  = Fo-dJ 


Mn)  = e2  f (V^)'(^(^) 


e=0 


A2(n)  = 0 


l+(^)2n+( 


e-l.^n(n-l)  I 
0 ^ 2 J 


IL^(n)  = (l,n,n  ) 


i(0-l)(3e+l) 


(9-1)^ 

2 


Morrison  gives  the  next  two  also  as 
Jl3(n)  = 0^  [1-3  n+3 


,l-0^  n(n-l)(n-2) 

- Wl J 


. / ^ „4  r,  ..  il-Qs  /l-e-i  n(n-l) 
i!.j^(n)  = 0 [1-4  (-0—)  n+6  (-g—)  — — 


(311) 


(312) 


(314) 


(315) 


(316) 


/l-e^^  n(n-l)(n-2)  . /l-6^  n(n-l)(n-2)(n-3)n 

- 4 (-5-)  jT + JJT 


4.' 


Morrison  states  that  this  set  of  polynomials  is  seen  to  have  an  in- 
finite number  of  elements  in  contrast  to  those  of  the  previous  section, 
which  form  a finite  set  for  any  given  value  of  N.  However  one  must  take 
this  statement  with  a grain  of  salt!  First  of  all  we  observe  by  Equation 
(308),  Eqxiation  (311)  and  Equation  (314)  that 
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. L-ri-;^!rT-i-rr 


[«,Q(n),  )l^(n),  n,  n ] 


1 


9 


6" 


(317) 


0 0-1 


(9-l)(3B+l) 

2 


0 


0 


(0-1)^ 
“T 


and  that  the  3^3  matrix  of  Equation  (317)  can  be  written  as 


where 


D(0)  = 


0 

0 


0 9 


1 

9 

92 

1 

1 

1 

0 

9-1 

i(9-l)(30+l) 

= 

0 

0-1 

1“ 

(0-l)(30+l) 

202 

0 

0 

CD 

1 

H 

N— / 

1 

0 

u 

0 

(^)'i 

^ e ' 2 _ 

(318) 


D(9) 


(319) 


The  matrix  of  Equation  (318)  with  unity  coordinates  is  the  Gram- 
Schmidt  matrix  of  Equation  (303)  corresponding  to  the  back  to  front  (going 
to  infinity)  span  metric.  Thus,  the  set  of  fitting  polynomials  used  by 
Morrison  on  page  500  of  Reference  [ ] seems  rather  nonsensical.  The  front 

to  back  of  span  metric  should  be  used  for  then  when  one  uses  these  approxi- 
mating functions  in  estimation  theory,  the  data  before  say  time  equals 
zero  can  be  assumed  to  be  zero,  and  one  has  a smoother.  Brown  in  Reference 
He  ] uses  the  metric  of  Equation  (283)  which  generated  the  Bg  matrix  for 
the  first  three  polynomials  of  Equation  (299).  Observe  that  the  matrices 
differ  in  sign  on  some  coordinates  hence  in  applications  to  fitting  func- 
tions in  data  processing  one  will  get  different  results. 

Furthermore  if  we  partition  these  Laguerre-type  polynomials  as  we  did 
for  the  discrete  Legendre  polynomials  of  Equation  (208)  (though  not  too 
mathematically  meaningful)  we  obtain  from  Equation  (302) 


330 


fA£. 


(320) 


G = 

0°^^(l,O,O) 

(N+l)x3 

0^^^(1,1,1) 

• 

• 

• 

0^^^(1,2,3) 

... 

0'^^^(l,n,n^) 

3^ 

_0^^^(1,N,N^)_ 

and  equating  elements 


B 

g 

3x3 


(321) 


If  we  use  the  concepts  from  the  continuous  Laguerre  polynomials  versus 
the  continuous  Laguerre  functions,  we  can  define  the  discrete  polynomials 
as 


[JlQ(n)^l(n),i!.2(n)]  = <|H(n)  = (l,n,n^) 


(322) 


e-1 

e 


(fl  -i)(3e+i) 


'■  0 ' 2 


for  n=0,l,2, • • ’Nx”,  hence  we  do  not  need  to  interprete  Equation  (322)  as 
an  infinite  set  of  polynomials,  for  one  can  deal  with  a set  of  three  poly- 
nomials of  degree  two. 

The  connections  between  the  Gram-Schmidt  polynomials  is  obtained  by 
Equation  (318) 


331 


B = B D~^(e) 
g mo 


(323) 


where  Bmo  is  the  matrix  obtained  from  Morrison's  polynomials  of  Equation 
(318);  using  Equation  (323)  in  Equation  (302) 


G = N B = N B d"  (0) 
(N+l)x3  g " 


(324) 


g'^g  = d"^(0)  b"^  n e D"^(e) 
3x3  mo  w w mo 


(325) 


and  the  metric  given  by  Morrison  page  66. 


I a An)  I An)  e'^  = r0;6  \ B 


(326) 


or  in  terms  of  the  g elements  of  Equation  (321),  that  is 


(go>gi’g2^  ~ (l,n,n  ) B 


(327) 


I gSn)  gjn)  = rO;6=f6 


(328) 


Specifically  one  should  write  Equation  (328)  as 


Jim  [ gx^n)  = I S.(n)  g„(n) 

^^x»  n=0  ^ ^ n=0  ^ ^ 


(329) 


Using  the  first  three  elements  of  Equation  (328)  in  Equation  (325) 


r^itwaniinti't Muaaawi 


L-0 


L 0^(i-0)j 

or  the  general  term  for  a d-1  degree  polynomial  yields 


0 

1 

0(1-0) 

0 


Note  that  the  only  difference  in  the  forward  and  backward  case  is  a 
sign  change,  hence  the  magnitudes  of  the  vector  are  the  same,  hence 
Equation  (332)  holds  for  both  cases. 

Orthonormal  Discrete  Laguerre  Polynomials.  The  two  cases  back  to  front 
and  front  to  back  orthogonal  vectors  will  be  normalized  to  obtain  the  unit 
magnitude  sets.  By  Equation  (305)  Section  ( 1 ) we  have  for  the  back  of 
span  to  front  case  of  Equation  (302) 


r ( 

' ' ^ 

I 

7 : 

■ J 

S 

(N+l)x3 

N B (g'^G)“^^^  = N B 
w g w s 

(333) 

) 

J 

where 

j 

B = B 
s g 

(334) 

or  by  Equations  (332)  and  (303) 

I' 

■ 

B = 
s 

0 

(335) 

• J ; 

1 

(0-l)(3  +1) 

20 

J. 

0 0 

(0-1)^ 

2 

J 

i ■ 

The  orthonormal  vectors  of  Equation  (333)  for  the  case  of 
back  of  span  is  the  same  as  Equation  (335)  except  for  the  sign 
in  the  positions  of  the  matrix  given  by  Equation  (229)  or 

front  to 
changes 

j 

r 

"l  S 

0 

(336) 

-(0-l)(30+l) 

20^ 

')  : 

: 

0 0 

(0-1)^ 

202 

One  can  obtain  the  same  orthnormal  vector  case  of  Equation 
using  the  orthogonal  vectors  of  Equation  (318)  with  powers  of 
first  row  of  the  matrix  with  the  square  root  of  the  inverse  of 
onal  metric  of  Equation  (328) 

(335)  by 

9 on  the 
the  diag- 

J • 

J 

Observe  also  that  the  Gram-Sclimidt  process  applied  to  the  vectors  with 
first  coordinates  constrained  to  be  the  powers  of  9 yields  the  matrix 
corresponding  to  those  polynomials  of  Morrison  (or  of  Equation  (328)). 

For  example 

) = 
i 

). 

334 

.1 

i 

■y- 

) 

H 

J 

l'. 

(N+l)x3 


2 


Forward  and  Backward  Exponentially  Weighted  Inverse  Metrics 
inverse  of  the  metric  matrix  of E quation  (168)  can  be  obtained  by  Equation 
(348)  Section  ( 1 ) as 


(N  = B m”V 

■■  ■■  g gg  g 


w w 


(339) 


and  by  Equation  (332)  and  Equation  (303)  is 


(/n  )-i 

w w 


(1-0 ) (1+0+0  ) 


^(l+0)(l-0)^ 


(1-0)^ 


-|(l+0)(l-6)^ 


(1-0)^(1+100+90^) 

40^ 

-(l-30)(l-9)‘^ 

.2 


40' 


(1-0)^ 


-(l-30)(l-0) 

40^ 

+(1-0)^ 

40^ 


where  by  Equation  (168) 


335 


1-6 

(1-0)^ 

(1-0)^ 

0 

0(1+0) 

6(1+40+0^) 

(1-6)^ 

(1-0)^ 

(1-6)“ 

0(1+0) 

e(i+40+0^) 

0(1+116+110^+0^) 

The  inverse  of  the  front  to  back  metric  of  Equation  (183)  that  is 
1 -0  (1+6) 


T 

r r = 

w w 


(1-0)' 
1+0 


(1+6) 

(1-0)^ 


(342) 


CM 

CD 

(1-0)^ 

(1-0)*^ 

(1+0) 

-0(1+40+0^) 

0(1+110+116^+0^) 

has  as  inverse  by  Equation  (332)  and  Equation  (299)  in  Equation  (339) 
r 3 1 

mii  ^ ^ r\  I 


(r^r  )‘^  = (i-e)(i+9+9^)  |(i+9)(i-6)^ 

W W Z 


(1-9)^ 

2 


|(l+6)(l-9)^ 


(1-6)^(1+100+99^)  (l-6)^(l+39) 


(1-0)  (1+30) 


The  inverses  of  the  two  cases  by  Gg  matrix  of  Equation  (299)  and  Equa 
tion  (303)  can  also  be  obtained  via  Equation  648  ) Section  ( 1 ). 


T 


The  Discrete  Laguerre  Polynomials  Orthogonal  over  the  Back  to  Front 
Span  in  Matrix  Factor  Form.  The  continuous  Laguerre  polynomials  of 
Section  ( 2 ) Equation  (54)  are  expressed  in  terms  of  the  binomial  matrix, 
factorial  matrix,'  etc. , hence  the  following  derivations  will  cast  the 
discrete  polynomials  in  similar  forms.  Consider  Equation  (307) 


il  (n)  = 0°  I (-l)V  (^)(") 

® e=0  ^ ^ 


where  6=0,1,2- • -d-l  the  polynomials  degree  and 


= (-1)^  = (-1)^ 


The  first  d polynomials  can  be  written  as 


lAn)  = 0°  I ( ) 


1 -L 

)l  (n)  = 0-^  I ( ) 
J-  , — n 


e=0 

1 

1 

e=0 

2 


KM  = e I i ) 

^ e=0 


e=0 


d-1 


or  as  a row  vector 


0 0 d-1 

(A„(n),A  (n), (n))  = ( I ( ).  I I ) D(0) 


e=0  e=0  £=0 


where  the  diagonal  matrix  is 
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(344) 


(345) 


(346) 


(347) 


0 (0) 

I ( ) = 

e=0 


(351) 


or 

()lQ(n),S,^(n),*--)l^_j^(n))  = I(-l)  D(b)  BD(0)  (355) 


or 

<&)Jt(n)  = <d)n^  ^I(-l)  D(b)  BD(0) 

where 


(356) 


(357) 


and  B is  the  binomial  matrix 


0 

CM  CM 

(^) 

(^) 

'■3-' 

(358 


( 


d-1 

d-1 


) 


The  Discrete  Laguerre  Polynomials  Orthogonal  Over  the  Front  to  Back 
Span  in  Matric  Factor  Form.  By"'EquatIon~r29^7'and~"EquatTorrT30’2r'we~s^e 


that  the  Bg  matrices  for  these  two  cases  differin  signs  in  alternating 
rows,  hence  by  inspection  it  is  clear  that  positive  axis  span  is  carried 
into  the  negative  axis  span  via 


B(-l) 


1 


-1 


B(+l) 


(359) 


or  element-wise  we  have  by  analogy  with  Equation  (307) 

{-if  (^)^  (^)  (^) 


e=0 


(360) 


The  row-vector  expression  of  Equation  (360)  is  by  analogy  with  Equa- 
tion (355) 


(llQ(n),Jlj^(n),*-*il^_^(n))  = [l,n^^\n^^\ • • I(-l) 


dia  (^)  BD(e) 


e-1. 


(361) 


dia  (— ) - 


(^) 

9 


(ili.) 
^ 0 ■' 


‘¥> 


d-l 


(363) 


Discrete  Gram-SchiTiidt  on  the  Matrix  T.  The  discrete  orthogonal  poly- 
nomials of  the  previous  cases  are  with  respect  to  the  non-dimensionalized 
time  spans.  By  Equation  (124). 


T = N T (i)D(hQ) 
(N+l)x3  (N+1)x3  3x3 


(363) 


By  Equation  (205) 
G 


B ^ = H 
N gU 

(N+l)x3 


(364) 


Using  Equation  (304)  in  Equation  (363) 


T 

(N+l)x3 


'"N 

(N+l)x3 


(365) 


T 

(N+l)x3 


% 

(N+l)x3  3x3 


(366) 


where  B^  is  upper  triangular  since 


^ = V T^(i)  D(hQ) 


(367 


f 

i 

r 


and  inverse  of  an  upper  triangular  matrix  is  upper  triangular  and  also 
Tn(i)  is  upper  triangular  and  products  of  upper -triangular  matrices  are 
upper  triangular.  Inverting  Equation  (366) 


= T = T D'^(h.)  T"^(i)  (368) 

N (N+l)x3  T 0 u gN 

By  Equation  (368)  we  see  that  an  orthogonalization  procedure  on  the 
coliunn  vectors  of  T using  the  columns  of  T as  a base  for  the  sub-space  of 
dimension  three,  yields  the  three  colvimn  vectors  of  G with  coordinates  given 
by  Bfi  in  the  T base.  Hence  one  can  obtain  the  discrete  orthogonal  poly- 
nomials in  many  forms,  and  as  shown  by  Equation  (367)  the  upper -triangular 
matrix  is  a function  of  the  fixed  time  interval  ho,  and  the  index  i. 


Section  6 SOME  GENERALIZATIONS  OF  THE  DISCRETE  DIFFERENCES  OF  POLYNOMIALS _MP 
THE  BASE  FITTING  FUNCTIONS. 

a . Generalities 

In  this  section  discrete  first  differences  and  higher  differences  of  sequences 
of  x(i)  and  of  the  fitting  function  f(i)  will  be  developed. 

Corresponding  to  the  three  different  indexing  notations  of  Figure  (1)  Section 
(4)  we  have 


x(i,0) 

x(i,l) 

x(i,2) 

1 ' 

I x(k-n) 

• 

x(k-l) 

x(k,0)) 

x(k,l) 

|x(i,N)| 

|x(k,n)  1 

x(l 

x(l 


x(l 


N) 

N)-l 


o) 


(1) 


and  the  corresponding  relations  on  the  fitting  functions  of  Eq.  (124),  Eq. 
(129)  and  Eq.  (135). 

I 


tCi,oy 

t(i,l) 


.t(i,N); 


t(k-n) 


t(k,0) 


't(l,N) 
t(l,N-l)^ 


^t(l,o) 


(2) 


t(k,n) 

] 

One  can  use  selector  matrices  and  evolve  an  "operational  matrix"  calculus 
in  the  same  manner  authors  introduce  operators,  for  example  for  the  first 
vector  sequence  of  Eq.  (1) 


< x(i)(H+^  = x(i,0) 


<£ 


<1 


= x(i,l) 


= x(i,n) 


(3) 


sJJ^x(i^  = x(i,N) 


343 


where  the  select  vector 


<6=  (1.  0 


0,  0 . . . 0) 
lx(N+l) 


and  the  shift  matrix  is  for  example  3x3 


/O  1 0 

S = I 0 0 1 

3::3  0 » 


For  the  midpoint  span  sequence  of  Eq.  (1)  one  can  map-down  via  the  vector 

<^+l)e^  = (0,  0 . . . 1,  0,  0 . . .)  = (^)O,  1,<M)0) 


<[^e^x(k)^  = x(k,0) 

" x(k,l) 

^®c^do^^^^^  ~ x(k,-l) 


where  the  shift-down  matrix  is  (e,g.) 


0 0 0\ 

1 0 0 ) = S 

0 1 0/ 


If  we  write  Eq.  (3)  in  terms  of  power  of  the  shift  operator  we  obtain  the 
obvious  identity 

/»(i.o)\  /<e  1 


x(i,l) 


x(i,2) 


x(i,n) 


<es“ 

I > uc 


I x(i,N) 


\4s^ 


where  N + 1 


(N+1)(N+1)  (N+1)(N+1) 


344 


I 


which  is  a Hankel  matrix. 

If  we  package  the  "data"  or  variables  with  the  "real-time"  or  most  advanced 
time  point  at  the  top  and  "shift  down"  we  have  for  the  array  of  spans 


x(i,3) 

x(i,2) 

x(i,l) 

x(i,0) 


x(i,4) 
x(i,3) 
x(i,2) 
x(i  ,1) 


x(i,5) 

x(i,4) 

x(i,3) 

x(i,2) 


x(i,6) 

x(i,5) 

x(i,4) 

x(i,3) 


or  a Teoplitz  matrix. 


Minimal  Set  of  First  Differenced 


Consider  next  the  sequence  under  U 


[x(i,0),  x(i,l),  x(i,2)  . . . x(i,N)] 


1 -1 


0 0 
(N+1)  X N 


= <N)  A^^^x(i)  = (A^^^x(i,0),  Ax^^^(i,l)  . . . Ax^^^(i,N-l) 


<^(i)  U = <^(i) 
(N+1)N 


where 


"-1  0 0 

1 -1  0 

U = 0 1-1 

(N+1)N  001 

0 


The  same  relations  hold  when  x are  vectors  x and  the  geometry  is  easier  to 
construct,  for  example  see  Figure  (1). 


I 


Figure  1 First  Forward  Difference  Vectors 


The  first  differences 

^^^^x(i,n)  = x(i,n+l)  - x(i,n) 

are  referred  to  as  the  first  forward  differences.  The  same  methods  developed 
herein  can  also  be  applied  to  the  so  called  backward  and  central  difference 
formulas,  but  will  not  be  done  here.  The  rather  standard  difference-operator 
techniques  used  in  Morrison's  text  and  others  is  not  "in  the  spirit"  of  the 
"matrix  of  the  operator"  state  space  approach  and  is  considered  very  tedious 
by  the  author  of  this  report. 

Return  now  to  Eq.  (9)  substituted  into  the  transpose  of  Eq.  (21) 

<e  x(i)> 


-1  1 0 0 . . . 

0 -1  1 0 . . . 


<es^^x(i)> 

<es2^x(i)> 

<^esJJoX(i)> 


1 « 
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A^^'^x(i,0) 


A^^^x(i ,1) 


A^^^x(i,2) 


where 


S - I = 
uo 


•1  1 0 0 0 
0-1  100 
0 0-110 


-1  1 
-1 


We  see  that  this  matrix  is  the  same  as  Eq.(110)  of  Section  (8)  for  b 
and  its  inverse  is,  for  example  4x4, 


/-I 

1 

0 

° \ 

-1 

/-I 

-1 

-1 

-1 

1 ° 

-1 

1 

0 ) 

I ° 

-1 

-1 

-1 

0 

-1 

1 / 

[ 0 

0 

-1 

-1 

\ 0 

0 

0 

-1/ 

V 0 

0 

0 

-1 

and  the  negat 

ive  of 

the 

above 

matrices 

yields 

1 -1  0 

0 1 -1 

0 0 1 

0 0 0 


0 0 

1 0 

1 -1 

0 1 


1 1 1 
0 1 1 
0 0 1 
0 0 0 


If  we  use  the  "so  called"  push-down  sequence  (column  vector  where  the  "real-time 
point  is  at  the  top  we  have  the  connection  via  the  "linear  convolution"  matrix. 


/x(i,N)  \ I \ /x(i,0)\ 

/ x(i,N-l)\  \ /x(i,l)l 


and  the  matrix  -U  where 


1 -1  0 . . . 

0 1 -1 

0 


( 


If  we  add  the  x(i,0)  element  to  the  bottom  of  the  vector  of  Eq.  (33)  we  have 
a full  rank  matrix. 


The  inverse  of  the  matrix  of  Eq.  (34)  is  given  by  Eq.  (29)  and  we  have 


(40) 


Consider  the  first  difference  vector  of  Eq.  (21) 

<:^)Ax^^^(i)  = <1i+l)  x(i)  U 

^ (N+l)xN 


Multiply  on  right  of  Eq.  (40)  with  U 

= <x(i)  UU*  = <x(i)P^ 


uu* 
(N+1)(N+1) 


(41) 


where  the  psuedo  inverse 'of  U is 

U*  = (u^u)"^u'^ 

N(N+1)  NxN  Nx(N+l) 

» 

and  by  Eq.  (21) 


(42) 


T 

U^U  = 
N N 


0 

-1 

-1 


0 

0 

1 


0 

0 


(43) 


or 


T 

U U = 


(44) 


-1 

-1  2 

NxN 

The  matrix  of  Eq.  (38)  is  called  the  Frank-matrix  by  Westlake  in  reference  (90) 

It  is  clear  that  for  the  (N+1)(N+1)  case  of  Eq.  (36)  one  replaces  n = N+1  in 
Eq.  (36). 


If  we  call  the  matrix  of  Eq.  (34)  A,  that  is 
A = I - S 

uo 

then  for  an  n x n matrix 

u^u  = AA^  + 

nxn 


(45) 


(46) 


and  using  the  Householder  inversion  lemma  for  inverting  a matrix  plus  a rank 
one  dyad,  we  have 


(u^u)"^  = (AA^)‘^  ,i  - e)^e  (aa'"’)'^] 

1 ,„4(aaV'^ 


(47) 
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Consider  the  elements  in  the  parenthesis  of  Eq.  (47),  by  Eq.  (38) 


<^e  (aa”^)"^  = (0,  0,  0 


• • 


1 2 3 ....  n 

= (1,  2,  3 . . . n)  = ^)c 

where  n)c  is  the  vector  of  counting  numbers.  We  have  also 
<^(AA^)’^e>„  = <c$>  = n 

Using  Eq.  (48)  and  Eq.  (49)  in  Eq.  (47)  we  have  the  factors 


(u'^u)"^  = (aa''')“^[i  - e^<^c] 


1+n 


The  matrix  in  brackets  is 


1 0 0 
0 1 0 
0 0 1 


1 -2  -3  1-n 


kl+n  1+n  1+n 


1+n 


Transposing  Eq.  (48)  and  using  it  in  Eq.  (50)  we  also  have 
T„^-l  _ ...T,-l 


(U^U)’^  = (AA^)"^  - cXj 

''l+n' 


The  dyad  is 


c^c  = 


A 

c =1  4 I (1,  2,  3, 


4 ...  n)  1 


-)■  t- 


(48) 


(49) 


(50) 


(51) 


(52) 


l+UllMl 


(53) 


the 

Frank  matrix 

of  Eq. 

(36)  in  Eq 

n 

n-1 

n-2 

n-3  . 

n+1 

n+1 

n+1 

n+1 

n-1 

2(n-l) 

2(n-2) 

2(n-3) 

n+1 

n+1 

n+1 

n+1 

n-2 

2(n-2) 

3(n-2) 

3(n-3) 

n+1 

n+1 

n+1 

n+1 

n-3 

2(n-3) 

3(n-3) 

4(n-3) 

n+1 

n+1 

n+1 

n+1 

1 

■5+1 


1 

n+1 


n 

STT 


(55) 


Westlake  gives  the  inverses  of  the  above  matrix  in  reference  (90)  page  140  as 

= [m*^  (56) 


T -1  -1 

(U^U)  = M ^ 


where 


T 

U U 


i(n-j+l) 
n+1 


for  i < j 


m.  . = 
ij 


(57) 


m . . 
Ji 


for  i > j 

Note  that  the  Frank  matrix  can  be  written  as 

<1 

2<  - ^ 

34  - 2 ^ - 1$ 

4<1  - 3 "<^3 


(u'^’u)"^ 


4 


For  example  the  4x4  case  one  has  by  Eq.  (55) 


(58) 


-1 

0 

o\ 

_4 

1 

2 

1 

2 

-1 

o\  = 

5 

5 

5 

5 

-1 

2 

1 

L 

1 

0 

-1 

2/ 

5 

5 

5 

5 

Z 

4 

6 

3 

5 

5 

5 

5 

1 

2 

3 

4 

5 

5 

5 

5 

(59) 


353 


JTJiy. 


Ortega  in  reference  ^5)  gives  the  eigenvalues  of  U U as 


=2-2  cos  kfl.  k = 1 . . . n 


with  the  corresponding  eigenvectors 


(sin  kfl.  sin  2 kfl.  . . . sin  nkfll  , k = 1 . . 
n+1  n+l'  n+1 


For  example  the  3x3  case  yields 

det 


<2-\  -1  0 

-1  2-\  -1 

r 0 -1  2-K 


= - 4A  + 


= -(A  - 2 + >/2‘)(A  - 2 - V5‘)(A  - 2) 

also  one  obtains 

detCu’^U  - AI)  = - A + 6A^  - lOA  + 4 = 0 


or 


A^  = (4,  -10,  6)  /I 

A 


The  companion  matrix  is 


A = 
c 


0 1 O' 

0 0 1 

,4  -10  6/ 


The  three  eigenvalues  of  Eq.  (63)  are 

/A  0 0 \ (2-^  0 0\ 

A = 0 A 0 = ( 0 2+V2  0 I 

\0  0^  \^/  Vo  0 2/ 

The  three  eigenvectors  of  Eq.  (61)  are  for  example 


n 


2) (2  - A) 


and  the  matrix  eigenverctors  is 


/1/V2 

I/V2 

l/^^2 

B = (pV  ^>2’  ^3^  = ( ^ 

0 

-1 

\l/V2 

-I/V2 

l/^/2 

Since  U U is  symmetric  its  eighnvectors  are  orthogonal,  that  is 


thus  the  unit  magnitude  orthogonal  eighnvectors  are 


B = 
u 


/I/V2  1/^  1/2  \ 

I1/V2  0 -1/V5 

\l/2  -I/V2  1/2/ 


and 

-1  T 

B = B 
u u 

and  we  have 


(U  U)B  = BA 


or 


b"^(U^U)B  = A 


The  Vandermonde  matrix 
1 1 

V = / ^2 

2 2 

S "2 


relates  the  companion  matrix  via  the  relation. 

A = V(U^U)V'^ 
c 

T 

The  inverse  of  U U for  the  3x3  case  by  Eq.  (55)  is 


By  Eq.  (73)  we 

also  have 

(u’''u)"^  = 

ba"^b'^ 

Using  Eq.  (77) 

in  Eq.  (42)  we 

have 

/-3  1 

1 

II 

3 

-2  -2 

2 

3x4 

\-l  -1 

-1 

and  the  orthogonal  projector 

is 

/ ^ 

-1 

uu"  = 

-1 

4x4 

1 -1  -1 

3 

\-l  -1 

-1 

= 

141  - 1(^<4)1]^ 

= 

I - (^<A)1 

4x4  ' 4 

(78) 


(79) 


(80) 


(81) 

(82) 


(83) 


the  orthogonal  conplement  projector  onto  the  1(4  vector.  Using  Eq.  (80)  in 
Eq.  (41) 

<Ax^^^(i)u'‘  = <x(i)UU*  = <x(i)P  (84) 

or 

^kx^^^(i)  = <(x(i)  - ^x(i)P  (85) 


where 


(86) 


Thus  if  one  is  given  the  three  difference  vectors  one  can  solve  for  the 
x(i)  up  to  the  component  lost  along  1(4  . 


For  the  (N+l)xN  case  it  is  obvious  that  N+l)l  lies  in  the  null-space  of  U, 
that  is 


1 U = <N)0 
(N+l)xN 


or  in  open-form 


(1,  1,  1 . . .) 


0 

-1 

1 

0 
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(87) 


(88) 


The  rank  of  U satisfies 


P u 
(N+1)N 


p(\J  U)  = N 
NxN 


(89) 


since  by  Eq.  (55)  it  is  invertible. 
Hence  Eq.  (81)  can  be  generalized  to 


UU  = I - l(N+l)><N+l)l 

(N+1)(N+1)  (N+1)(N+1) 


(90) 


or 


UU  = P 


By  Eq.  (7A)  and  (76) 

U^U  = BAB"^  = V“^A  V 
NxN 


(91) 


(92) 


or  structure  wise 

* T _ 1 T 

UU  = U(U  U)  U 

-1-1  T 
= UV  A VU 
c 

-1  -1  T 
= UBA  'b  U^ 


(93) 

(94) 

(95) 


The  inverse  of  a companion  matrix  is  given  by  Brand  reference  (14)  as,  for 
example, 


0 

1 

0 

-b 


-1 


-b/d 

0 

1 

0 


-a/d 

0 

0 

1 


(96) 


and 


det  (a'^  - AI)  = a***  + c + b + a a + 1 
^ d J d d 


(97) 


In  conjunction  with  these  hints  of  structural  approaches  one  should  consider 
the  Lancos-Decomposition  of  U as 


U 


SL  a Z 
(N+l)xN  (N+l)xN  (NxN)  (NxN) 


(98) 


where 


iihg  = T = vlv. 
* NxN 


(99) 
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or  in  terms  of  the  unit  magnitude  eigenvector  matrix 


T 2 T T 

U"U  = = B AB^ 

je  a £ u u 


(10 


where 


- 


A = A 
a 


(10 


and  positive  square-roots  are  taken,  hence 


V = B 
£ u 


(10 


We  have  also 


T 2 T 

UU  = V„A„Vo 

(N+1)(N+1)  " ^ 


(10^ 


and 


(u«) 


uos: 


and  an  alternate  expression  for  U of  Eq.  (42)  is 

J 


(uu’') 


U = U' 

N(N+1)  Nx(N+l)  (N+1)(N+1) 


(106, 


Further  structural  properties  can  be  developed  but  will  not  be  pursued  further 
here. 


The  outer-Grammian  matrix  for  the  4x4  case  of  Eq.  (106)  is 


T 

UU  = 


4x4 


(107' 


Finally  by  Eq.  (55)  in  the  general  case  of  Eq.  (42) 

u”  = 

N(N+1) 


U*  = (U^U)"^U^ 


(lOfi 


3/2 


4/3 


n+1 

n 


-1/2 

1 -2/3 

1 


with  det  = 2 • • (n+1)  = n+1  product  of  pivots 


c.  All  Combinations  of  First  Differences 


This  portion  and  the  portion  on  weighted  differences  is  added  as  a generalization 
but  will  not  be  used  extensively  in  this  report.  In  many  applications  such  as 
taking  first  differences  of  radar  measurement  vectors  from  n-stations,  or 
sight-line  measurement  vectors  from  optical  instruments,  etc.,  one  finds  need 
for  such  analytics. 


Consider  a "dyadic  product  on  a differencing  relation". 


^0 

\ 

o 

o 

AXqi  . 

^1 

® (Xq,  Xj,  X^  . . . Xjj)  = 

"^10 

AXii 

^N 

• 

^NO 

^NN 

where 


Ax . 
in 


/X  - X.  i ^ n 

( ^ ^ 

\ 0 i = n 


(112) 


(113) 


2 

There  are  (N+1)  elements  in  the  matrix  of  Eq.  (112),  eliminating  the  N+1 
diagonal  zero  elements  and  using  the  symmetry 


Ax . 


in 


-Ax  . 
ni 


we  have 

(Nt.l)^  - (N+l)  = (N+1)  [N+1  - 1]  = N(N+1)  = M 
z z z 


(114) 


For  example  for  N+1  = 4 

M = 4(3)  = 6 
2 


(115) 


360 


I 


W 

AO>A04a  718  NATIONAL  RAN8E  OPERATIONS  DIRECTORATE  WHITE  SANDS  MIS— ETC  F/6  16/2 

STATE  SPACE  TECHNIOUES  IN  APPROXIMATION  THEORY  WITH  APPLICATION— ETC (U) 
SEP  77  J S PAPPAS 

UNCLASSIFIED ACD-6»»77»V0L-1 NL 


AO 

A04e7ie 


or  six  differences  of  the  4 variables.  The  difference  matrix  yields 

"l  -1  -1  0 0 0 1 

(x„,  X , X , X-)  10  0-1-10  = <xU 


-1 

-1 

-1 

Xj,  X^,  X 

3^ 

1 

0 

0 

1 

0 

0 

0 

0 

1 

= (AXqj, 

AXo2. 

"^03 

, Zlx 

12*  ^ 

grammian 

is 

3 

-1 

-1 

-1 

= 

-1 

3 

-1 

-1 

-1 

-1 

3 

-1 

-1 

-1 

-1 

3 

UU^  = 4(1  - 1><^1)  = 4 P 

4x4 

By  Eq.  (118)  we  see  that  U has  rank  equal  P or 

p(U)  = p(Uu'^)  = pP  = 3 
4x6  4x4 

The  psuedo  inverse  of  Eq.  (118)  is 
(UU^)"  = ^ P 


(116) 


(117) 


(118) 


(119) 


(120) 


(UU^)(UU^)''  = (UU^)*(UU^)  = P 


(121) 


'T'  'T' 

u"  = U (UU  )" 


u"  = u^(^s)  P = ^ 
6x4  4x4 


T~  T 
UP  = U 


The  inner-projector  is 
UU*  = UU^(^) 

and  by  Eq.  (118)  in  Eq.  (125) 

UU*  = P = I - iXi 
4x4  4 


(122) 

(123) 

(124) 

(125) 

(126) 


and  the  entries  are  3x3.  The  corresponding  outer-projector  becomes 


21 

I 

I 

-I 

-I 

0 

..I. 

I 

21 

I 

I 

0 

-I 

u^u  = 

I 

I 

21 

0 

I 

I 

18x18 

-I 

1 

0 

21 

I 

-I 

-I 

0 

I 

I 

21 

I 

L 0 

-I 

I 

-I 

I 

21 

By  inspection  it  can  be 

seen 

that 

U of  Eq. 

(116) 

has 

full 

rank 

-1 

0 

o' 

1 

1 1 

0 

0 

0~ 

U = 

1 

-1 

0 

0 

1 1 

1 

1 

0 

4x6 

0 

1 

-1 

0 

0 1 

0 

1 

1 

0 

0 

1 

4 X 

3 

3 

X 6 

Express  U in  terms  of  the  full  rank  factor  and 

U = A B = A B 
4x6  4x3  3x6  4x3  3x6 


and  the  psuedo  inverse  is  the  commuted  product  of  the  psuedo  inverse  or 

Ju  J. 

U = B a" 

6x4  6x3  3x4 

and  the  two  associated  projectors  are 

UU"  = ABB"a''  = AA* 

4x4 


since 

BB"  = A^A  = I 
3x3 

and  the  commute  of  Eq.  (138)  is 

* * 

U U = B B 

6x6 

Since  the  matrix  A of  Eq.  (138)  is  Eq.  (23),  by  Eq.  (Ill) 


The  6x6  projector  is  given  by  Eq.  (140)  and  the  B matrix  is 
•k  T T -1 

B = B (BB  ) ^ 

6x3 
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One  can  obtain  the  eigenvalues,  eigenvectors  and  Vandermonde  matrices  associated 
with  the  full  rank  matrix  of  Eq.  (143)  as  was  done  with  the  matrix  of  Eq.  (59) 
to  obtain  more  structure;  but  It  will  not  be  pursued  further  here. 


One  Interesting  representation  of  the  rank  N+1  projector  of  Eq.  (Ill)  Is 

UU*  * ^ [(N+l)  I^-4.ll  1 

(N+1) (N+1)  L J 

■ (sh)  " ^ 

1 N - L\ 


(147) 

(148) 


- 


Li  = A*-i)  1 = (1.  1,  ...  1) 

(N+l)xl 


(149) 


It  can  be  shown,  though  It  will  not  be  derived  here  that  Eq.  (128)  generalizes 
to  maximum  combinations  of  Eq.  (114)  where 

..  N(N+1) 

M 2 


U*U  = (I  - 1 (^>^)  1)  U (N)  (150) 

MxM  MxN  NxN  N N:di 

The  applications  of  some  of  these  matrices  to  obtain  position  solutions  by 
minimizing  the  sums  of  the  squares  of  the  magnitudes  of  all  combinations  of 
first  differences  is  given  In  ref  (9^. 

d.  Weighted  Difference  - Matrices 


Consider  next 

the  weighted  differences 

of  Eq. 

(21)  (with  the 

Index  shifted  to 

1 , 2 , ...  n) , 

that  Is 

r 

(Xj^ , X2 , 

X3,  ...  x^)  -w,3 

0 

0 

...  0 

”21 

■''22 

0 

0 

■ 0 

"32 

■''33 

• ! 

j 

' 0 

0 

w,  - 

1 

43 

! 

; 

• 

0 

• 

• / 

. 

• 

• 

• 

• 

''m-1,  M-1 

0 

0 

0 

W 

M,  M-1 

Mx(M+l) 

~T 


M-1)  A X 


w 


where 


-^M^)  Ax^  - ''32’‘3"''32*2’  '••  ''m*N"''n-1*N-1^ 

as  an  example  one  can  obtain  divided  differences  if 


(151) 


(152) 


”21  ''11  ^^^1 


M-1  “ '^M-l,  M-1  ° ^^^-1 


(153) 


and  Eq.  (152)  becomes 


^M-1)  Ax  = 
\ w 


X2-X1 


x -X  , 
n n-1 

h 1 

n-1 


(154) 


Consider  the  minimum  set  (4x3)  case  for  the  special  constraint  as  shown 
below,  that  is 

W21  = W22 

W32  = w^^ 


^2’  ^3’  ^4^  “”l 

0 

0 ' “ <^)  xU  ■ ■ 
w 

s^)  Ax 

(155) 

”2 

-W2 

0 1 

0 

''3 

-W3 

J 0 

0 

W/.  . 

The  4x3  weighted  difference  matrix  can  be  written  as 

U = W U 
w 

4x3  4x4  4x3 


(156) 


where 


W 

4x4 


0 

”2 

0 

0 


0 

0 

"3 

0 


0 

0 

0 

w. 


(157) 
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and  the  psuedo-lnverse  Is 


U * - (U  U )”^  U 
w w w w 


3x4 


3x3 


(158) 


and 


U * - U ^ (U  U ^)* 

W WWW 

4x4 


(159) 


The  Inner-Granmlan  of  Eq.  (156)  is 

r 

0 


T 

U U 
w w 


-Wj 

0 

0 


-W- 


L 


,Wi  + w^ 


-W„ 


W, 


-W, 


r-.. 


0 I 


w 


4! 


0 

0 


-Wz 

2^2 
W2  + W3 


-w^ 


-W^ 


2 ^ 2 i 

»3  + »4  i 


-W„ 


W, 


0 

0 

-w^ 

w 


^ J 


(160) 


One  can  obtain  the  Inverse,  elgheuvalues,  eigenvectors,  companion  ^trlx  etc. 
for  the  full  rank  case  of  Eq.  (157)  for  different  conditions  on  ^)  w; 
however,  it  will  not  be  done  here. 


The  4x4  outer  Grammlan  is 

u u = w uu"^  w 

w w 
4x4 

and  by  Eq.  (107) 


U U 
w w 


U U 
w w 


r 

1 1 

-1 

0 

0 

= w 

= t— 1 

2 

-1 

o; 

w 

^ 0 

-1 

2 

-ii 

0 

0 

0 

2 

''i 

-W1W2 

0 

0 

1 

1 -«l’'2 

2w^ 

2 

-W2W3 

0 

! 0 

-W2W3 

CM 

-w.w 
3 ‘ 

1 

! 

1 

0 

1 

0 

-w  w. 

3 4 

2 

”4 

(161) 


(162) 


(163) 


367 


Consider  next  the  maximum  combinations  of  four  things,  or  the  4x6  case,  one 
has 


4x6 


where 

U - W U 
w 

4x6  4x4  4x6 

Using  the  full  rank  3 factors  for  U of  Eq.  (135) 

U - WAB-A  B 

w w 

4x6  4x44x33x6  4x3  3x6 

U * - b*A  * 
w w 

6x4 

and 

U U * = A A * 
w w w w 

4x4  4x3 

where 

W U = A = U 

w w 

4x4  4x3  4x3 

Is  given  by  Eq.  (156)  and 

T -2  T 
U * = (U  U ) U 
w w w w 

3x4  3x3 

hence  one  needs  to  Invert  Eq.  (160)  to  obtain 
The  elements  of  the  matrix  of  Eq.  (165)  are 


(164) 

(165) 

(166) 

(167) 

(168) 

(169) 

(170) 

(171) 
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W 


-Wi 

■”l 

"”l 

0 

0 

0 

W2 

0 

0 

-W2 

■”2 

0 

0 

W3 

0 

”3 

0 

-w, 

0 

0 

”4 

0 

”4 

V 

i 

Corresponding  to  the  difference  relations 


3 


(172) 


(Xj^  X2  X^  X^) 


■”1 

*-w 

1 

-Wi 

0 

0 

0 

"2 

0 

0 

■”2 

-W2 

0 

0 

^^3 

0 

''3 

0 

-w, 

0 

0 

''4 

0 

”4 

w 

i 

= (w2X2“W^Xj^,  w^x^-Wj^Xj^,  w^x^-Wj^Xj^,  W2X2~W2X2» 


'^4^4”'^ 3*3^ ' 


(173) 


The  Inner-Grammlan  Is 


U U 
w w 


4x4 


3w^ 

^ 1 

-W1W2 

■”l”3 

-W-W 
1 ^ 

■”l”2 

3w^ 

•^2 

-W2W3 

CM 

1 

-W3W1 

-W3W2 

3w^ 

JW3 

-W3W^ 

-W4W1 

-W4W2 

-W4W3 

3w^ 

^4 

W 


T 

U U 
4x4 


W - 4W^-^X^ 


(174) 


(175) 


and  by  Eq.  (118) 
T 


U U 
w w 


W 


4(1  - 1 (4><^)  1 W 


(176) 


The  outer  Grannnlan  Is 
T 

U U 
w w 


6x6 


,2^2 
Wi  + W2 


'1 

.2 


-w„ 


w. 


(177) 
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-w„ 


Wo 


-w. 


2^2 
"2  "3 


w 


-w. 


"2 

-W3 

2 

^ 2 

2 

W2 

+ «4 

2 

2 

''4 

w 

3 

+ w' 

A second  weighted  difference  matrix  (as  an  example)  for  the  minimal  set  is 


-w. 


w. 


-Wo 


w. 


0 

w. 


-w^W2-W2 

-w^-w^w^ 


-Wj 

0 

0 


w. 


-Wo 


W2W3 


-W2W3-W3 


0 

w. 

-Wo 


''3W4 


0 

0 

w. 


(178) 


.th 


K Forward  Differences  From  Back,  of  Span  to  Front 


The  following  considerations  of  first,  second,  third,  and  differences  will 
be  restricted  to  unweighted  and  only  the  minimum  set  of  differences  (not  all 
combinations  of  differences).  For  example,  consider  the  five  point  span  of 
data  or  variables  as  column  vectors. 


or 


X (i,  0) 

X (i,  1)  1= 
X (i,  2) 
.A^^^  X (i,  3)> 


A^  X (1)  (^  = u''^  X (1) 

4x5 


(179) 


(180) 


J 


7.1 


The  second  difference  vector  is 

A^  x(i,  0)\ 

A^  x(i,  1)  1= 

^A^  x(i,  2)/ 


x(i,  3)- 


(181) 


or 


A"  x(i)  (3 


U U 
3x4  4x5 


x(i)  (|> 


(182) 
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L 


i I ^iii 


iiMiiUiafei&ilk 


T 


where  the  distinction  in  the  difference  matrices  is  indicated  by  the  size. 
The  matrix  product  of  Eq.  (182)  is 


x(l,  0)\ 

1-2100 

x(i.  0)“ 

x(i,  1)|= 

01-210 

x(i,  1) 

x(i,  2)/ 

0 0 1-21 

x(i,  2) 

x(i,  3) 

__  / J /.  \ » 

(183) 


The  third  difference  yeilds 
.3 


x(i,  1)/ 


-1 

0 


or  in  terms  of  the  x(i) 

.3 


/A-"  x(i,  0)\ 
\A^  x(i,  1)/ 


1 

-1 


-1 

0 


3 

-1 


-3 

3 


A x(i,  0) 
A^  x(i,  1) 
'vA^  x(i,  2) 


1 

-3 


The  fourth  and  final  difference  is 
A^  x(i,  0)  = (-1,  1)/A^  x(i, 


)/A^  x(i,  0)\ 
\A^  x(i,  1)/ 


x(i,  0) 
x(i,  1) 
x(i,  2) 
x(i,  3) 
x(i,  4) 


(184) 


(185) 


(186) 


or 


A x(i,  0)  = (1,  -4,  6,  -4,  1) 


'x(i,  0)' 
x(i,  1) 
x(i,  2) 
x(i,  3) 
^x(i,  4)> 


Packaging  the  previous  equations  at  the  initial  part  n=0»  and 
A^°^  x(i,  0)  = x(i,  0) 
we  obtain 


(187) 


(188) 
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(189) 


x(l,  0) 
x(i,  0) 


x(i,  0)  1=  1 -2 

A^^^  x(i,  0)  / -1  3 

A^^^  x(i,  oy  1 -4 


10  0 0 

-110  0 
1-210 
-1  3-3  1 

1-4  6-4 


x(i,  0) 
x(i,  1) 
x(i,  2) 
x(l,  3) 
x(l,  4) 


Observe  that  the  matrix  of  Eq.  (189)  is  the  transpose  of  the  inverse  of  the 
binomial  matrix  of  Eq.  (35)  appendix  (A),  or 


Ax(i,  0)(^g  = B"^x(i)(^ 


(190) 


where  the  vector  of  Eq.  (189)  is  the  discrete-analog  of  the  continuous  state 
vector  of  Eq.  ( ) sec  ( ) that  is 


x(i,  0) 

x(t) 

Ax(i,  0) 

x(t) 

A^^^xd,  0) 

_x(t) 

A^^^xd,  0)| 

X (t) 

A^^^xd,  0)' 

x^^^t) 

It  is  obvious  that  the  n discrete  difference  package  is 
/x(i,  0)  V ,x(i,0)  V 


x(i,  0) 
Ax(i,  0) 
A^^^x(i,  0) 


A^”^x(i,  0) 


= b"'^/  x(i,  1) 


x(i,  M) 


(191) 


Multiply  Eq.  (190)  by  B , hence 
x(i)(^  = B^  Ax(i,  0)  (^^ 


(192) 


x(l,  0> 
x(i,  1) 
x(i,  2) 
x(l,  3) 
x(l,  4i 


x(l,  0) 
Ax(i,  0) 
A^^^x(i,  0) 
A^^^xd,  0) 
A^^^xd,  0) 


(193) 


An  extension  of  the  vectors  of  Figure  (1)  yields  the  second  differences  geometry 


Figure  (2)  Second  Forward  Difference  Vectors  that  Is 

Ax^^\l,  n)  = Ax^^^(l,  n+1)  - Ax^^^l,  n)  (194) 

One  can  construct  similar  geometry  for  the  higher  differences. 


If  we  package  Eq.  (179y , Eq.  (181),  Eq.  (184)  and  Eq.  (187)  as  a row  of  column 
vectors,  we  obtain 


x(i,  0) 
x(l,  1) 
x(i,  2) 
x(i,  3) 
x(i,  4) 


A^x(l,  0) 

A^x(i,  0) 

a\(1,  0)  A 

^x(i,  0) 

A^x(i,  1) 

A^x(i,  1) 

A^x(l,  1) 

0 1 

A^x(i,  2) 

4^x(i,  2) 

0 

0 i 

1 

A^x(i,  3) 

0 

0 

0 1 

0 

0 

0 

0 

, U xN, 

U U x(i)\. 

U U U x(i)^ 

J 

, u u 

u u 

4x5 

3x44x5  / 

2x33x44x5 

1x22x33x44x5 

0 

0 

0 

C 

I 

0 

0 

C 

1 

0 0 
0 


(195) 


J 


Note  that  the  first  row  vector  of  Eq.  (195)  Is  the  transpose  of  the  discrete 
state  vector  of  Eq.  (188). 

Returning  to  Eq.  (188),  If  the  fourth  difference  vector  Is  zero  for  all  1,  that 
Is 

A^xd,  0)  H 0 - (1,  -4,  6,  -4,  1)  x(i)  (5>  (196) 

for  Vi  = 0,  1,  2,  ... 


or 
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(19 


x(l.  A)  = (-1.  4,  -6,  4)  /x(i.  0)V 

I x(i.  1)  ) 
I x(i.  2)  ] 
\x(l,  3)/ 


Using  the  dependence  relation  of  Eq.  (197)  we  obtain 


’x(i.  0 
Ax(i,  0) 
A^x(i,  0) 
0) 

A^x(i,  0)/ 


-T 

= B F 


x(i)  (^ 


where 


-T 

B F = 
5x5  5x4 


1 

-1 

1 

-1 

0 


0 

1 

-2 

3 

0 


0 

0 

1 

-3 

0 


0 

0 

0 

0 

0 


hence  for  the  condition  of  Eq.  (195),  we  need  only  consider  the  4x4 
that  is 


x(i,  0) 
A^x(i,  0) 
A^x(i,  0) 
a\(1,  0) 


-T 

B 

4x4 


or 


Ax(l)  (^g 


-T 

= B 
4x4 


x(i)  (^ 


The  general  connection  of  Eq.  (13)  between  successive  spans  for  the 


(19( 

(199 

(200 

case, 

(201 

(202 

5x5  case  Is 


x(l+l,  0) 
x(i+l,  1) 
x(i+l,  2) 
x(i+l,  3) 
x(i+l,  4) 


(x(i,  0)\ 

x(l,  1)  \ \ 

X(i,  2)  +e(^s 

x(i,  3)  / / ^ 

x(l,  4)/ 


By  Eq.  (197)  we  have  for  1+1 

x(i+l,  4)  = (-1,  4,  -6,  4)/x(i+l,  0)  \ - <^x(i+l) 

I x(i+l,  1)  1 ^ 

\ x(i+l,  2)  / 

\x(i+l.  3)/ 

Eq.  (204)  can  be  rewritten  as 

x(i+l,  4)  = (0,  -1,  4,  -6,  4)  x(i)  (^ 

= x(l)  (^ 

Using  Eq.  (205)  in  Eq.  (203) 

x(l+l)(|>  + e (^5  <5>  ' 

■ fuo  e (>5  c]  x(l)  (5> 


x(i+l)(>  = 


:(i)(|> 


which  is  clearly  singular.  The  full  rank  transition  matrix  can  be  obtained 
from  Eq.  (197)  where 


x(i+l,  3)  = x(i,  4)  = 


(-1,  4.  -6,  4)/x(i,  0) 
( x(i,  1) 
\ x(l,  2) 
\x(l,  3) 


x(i+l,  0) 
x(i+l,  1) 
x(i+l,  2) 
x(i+l,  3) 


0 1 

0 0 

0 0 

1 4 


x(i,  0) 
x(l,  1) 
x(i,  2) 
x(i,  3) 


x(i+l) 


* X 
XX 


(i)  (J> 


(211) 


Note  that 


-4  15  -20  10  I 

I-  J 

we  can  obtain  a transition  matrix  on  the  discreet  states  by  Eq.  (199) 
assumptions  of  Eq.  (197))  as 

(x(l,  0)  \ 10  0 0 

Ax(i,  0)  1=  -1  1 0 0 x(^ 

A^x(i,  0)  i 1-210 

a\(1,  0)/  -1  3-3  1 


(212) 


(for  the 


(213) 


x(l+l,  0)  \ 
Ax(i+1,  0)  \=  b" 

A^x(i+1,  0)  I 
A\(i+i,  oy 


c(i+l)(4> 


(214) 


Using  Eq.  (210)  and  the  Inverse  of  Eq.  (213)  in  Eq.  (214) 


Ax(i+1)(^ 


-T  T 

= B 4>  B 

XX 


Ax(i)(^^ 


4Ax(1)(^^ 


where 


— T T 

«■..  = B B 

AA  XX 


(215) 


(216) 


(217) 


or  in  open  form  the  transition-matrix  is 


(218) 


(219) 
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Discrete  Differences  of  the  Fitting  Functions 
When  the  variables  x(l,  n)  are  expressed  In  the  form 


x(i,  n) 


:(i,  n)^ 


One  obtains  for  example 

Ux(i)(!>  = U f(i,  0) 
f(l,  1) 
f(i.  2) 


f(i,  n) 


Uxd); 


f(l,  1)  - f(i,  0) 
f(i,  2)  - f(i,  1) 


f(i,  n+1)  - f(i,  n) 


f(i,  n)  - f(i,  n-1) 


etc  for  higher  differences. 

The  general  terms  by  Eq.  (201)  for  Forward  Differences 


/x(i,  0)  \ 

I Ax(l.  0)  \ 

=1  A^x(i,  0)  I = b"'^ 


l\{±,  0) 


x(i,  0) 
x(l,  1) 
x(i,  2) 


x(i,  n) 


(220) 


(221) 


(222) 


= x(i)(N+^  (223) 


iA\(i,  0) 


x(i,  N) 


«<1.  0)  0 

lx(l.  0)  |(J)(-^.  (i)(-l).  0 

- (5)(-^P.  (J)(-1).  . 0 


x(l,  0) 

x(i,  1) 


_A<i.  o,J  b(-^.  (;)(.^  , ..,(J)  .x»  ,) 


and  by  Eq.  (6^  appendix  (A)  the  general  term  Is 

Ax"(i.  0)  . (-!,>'  Q 


B Ax< 


and  the  general  term  Is 


x(i,  n)-x(i,  0)+nAx(i,  0)+  "^"-^^A^xd,  0)+  ...  +A’^x(i, 


x(l,  n)  - (“)  A^'xd,  0) 

k»0 

By  Eq.  (53)  appendix  (B) 

S cj 

B . s.  cl 


■ '=E  % t 


(228) 


(229) 


(230) 


(231) 


(232) 


and  using  Eq.  (232)  In  Eq.  (223) 


Ax(l,  0)(N+^g  - f S"^  C"^  x(l)(N+j> 


(233) 


Consider  the  following  example  where  the  matrices  are  4x4,  and  the  polynomial  Is 
of  degree  3 


.2  _3 


x(l,  n)  = (1,  n.  n , n^)  T^(i)  T^(6)D(ho)^ 


(234) 


x(i,  n)  = <^  T(i,  e,  h)  ^ 

x(i,  n)  = <^)  n 


and  for  4 points 


x(i)  (^  = 


Ur>iTi,  ••’^6)  in  Eq.  (233) 


- t s:^  .'> 


where 


-T  -T 

TSu  = B c, 


If  the  discrete  states  are  desired  at  i+n,  then  by  Eq.  (224) 
' x(i+n,  0)  ix(i,  n)  j |x(i+n,  0)  | 


x(i+n,  0) 
x(i-l-n,  1) 
x(i+n,  2) 


x(i+n,  N) 


' x(i+n,  0)  ix(i,  n)  | 

' A^x(i+n,  0)  = A^x(i,  n)  ! = B ^ 

. A^x(i,  n)  i 


I A^x(i+n,  0)  , I A*^x(i,  n)  | 
and  the  n^^  term  of  Eq.  (240)  is 

a"  x(i,  n)  - Q (-l)J  x^^.j 


K Backward  Differences  From  Front  of  Span  to  Back 


A number  of  authors  use  the  notation  and  distinction  between  the  forward 
difference  operator 

Af  “ f - f 
n n+1  n 

and  the  backward-difference  operator 


(243) 


Vf  = f - f , 
n n n-1 


for  V read  "Nabla"  and  A read  "Delta". 


If  we  consider  the  linear  convolved  equation  of  Eq.  (30)  where  the  real-time 
point  x(l,  N)  Is  at  the  top  of  the  span,  we  obtain 


Vx(l,  N) 
7x(l,  N-1). 


Vx(l,  n) 


Vx(l,  0) 


-1  0 
1 -1 


-1  0 
1 -1 


x(l,  N) 
x(l,  N-l)i 


(244) 


1 -1 


x(l,  1) 
x(l,  0) 


N x(N+l) 


T T 
E U,"  = -U 
b 


(245) 


The  matrix  generates  different  transition  matrices,  etc. 

Consider  now  the  front-to-back-span  of  Eq.  (1)  but  with  the  span  front  time 
point  at  the  top,  that  is 


x(Jl)(N+^  = /x(a,  0) 

/ Ml,  -1) 
/ x(£,  -2) 


Ml,  -N) 


(246) 


and  the  backward  differencing  operator  of  Eq.  (245)  operating  on  Eq.  (246) 
transposed 

<^1)  x(S,)  *<(n)  Vx(Jl) 

where  for  the  4 point  case  the  column  vectors  are 


(247) 


/Vx(l-0)\ 

/I 

-1 

0 

/Mi-0)  \ 

I Vx(l-l)  |« 

■ 0 

1 

-1 

0 

/ x(Jl-l)  ) 

\Vx(l-2)/ 

Vo 

0 

1 

-1/ 

1 x(£-2)  i 
\x(ll-3)/ 

(248) 


The  second  backward  differences  are 


/v^x(Jl-0)\ 

Wx(l-l)l 


-1 

1 


0 

-1 


'Vx(*.-0)' 

7x(A-l) 

vVx(£-2), 


or  by  Eq.  (248)  in  Eq.  (249) 

,2 


/V^x(Jl-O)  \ 
\7^x(£-l)/ 


-2 

1 


1 

-2 


The  third  backward  difference  is 
3 


V^x()l-0)  = (1,  -3,  3,  -1)  x(£)  (^ 


Packaging  the  "discrete  states" 


Vx  (A-O) 


V x(il-O) 


V‘^x(Jl-10) 


V x(Jl-10)> 


0 

-1 

-2 

-3 


0 

0 

1 

3 


0 

0 

0 

-1 


which  is  the  transpose  of  the  Rutishauser  matrix  of  Eq.  (76)  appendix  (A) 
hence  the  general  case  is 


Vx()l)  (N+^g  = x(il)  (N+^ 


Since  by  Eq.  (94 , appendix  (A)  the  Rutishauser  matrix  is  its  own  inverse 
x(l)  (N+^  = R^  Vx(Jl)  (N+^g 


If  x(Jl,  j)  is  a third  degree  polynomial  then  by  Eq. 
4 ^ 

x(A-O)  E 0 =«  (1,  -4,  6,  -4,  1)  /x(£-0)' 

x(Jl-l) 
x()l-2) 
x(£-3)^ 


(196) 


for  all  £.. 


Successive  spars  of  4 data  points  are  connected  via 


(x()l+l-0)\  /x(£+l)\ 

xU+l-l)  1*1  xU)  I* 
x(l+l-2)  / I x(jt-l)  j 
x(£+1-3)/  \x(jl-2)/ 


0 0 
1 0 
0 1 
0 0 


0 

0 

0 

1 


0 

0 

0 

0 


(x()l-0)\ 
x(i-l)  \ 
x(fc-2)  I 
x()l-3)/ 


+ e>^  x(a+l) 
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(257) 


If  we  advance  Eq.  (255)  one  step  to  H+l,  we  have 

x(£+l,  0)  - 0 = (1,  -4,  6,  -4,  1)  /x()l+l-0)\ 

/ x(£+l-l)  ) 
I x(£+l-2)  j 
\x(£+l-3)/ 


or 


x(£+l)  » (4,  -6,  4,  -1)  /x(£-0) 


/x(£-0)  \ 
x(£-l) 
\x(£-2)/ 


Using  Eq.  (258)  in  Eq.  (256) 


'x(£+l)\ 
x(£-0)  ] = 
x(£-l)  j 
,x(£-2)/ 


4-6  4-1 
10  0 0 
0 10  0 
0 0 10 


'x(£-0)> 

x(£-l) 

x(£-2) 

,x(£-3)y 


or 


x(£+l)  (^  = $ x(£)  (4^ 


(258) 


(259) 


The  discrete-state  relation  of  Eq.  (253)  holds  for  the  (£+1)*^^  span,  hence 

Vx(£+1^^  = x(£+1)^ 

and  by  Eq.  (259)  and  (254) 


or 


Vx(£+1^^  = Vx(£)>^ 


where 


$ = R 

VV 


(260) 


(261) 


xxb 


(262) 


(263) 


(254) 


or 


VV 


1 1 
0 1 
0 0 
0 0 


1 

1 

1 

0 


1' 

1 

1 

1/ 


(265) 
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It  Is  of  Interest  to  observe  that  one  can  also  obtain  the  transition  matrices 
In  a different  way.  For  example  at  1+1,  we  have 


'x(l+l,  0)  \ 

x(l+l,  -D)  • ,r.  T (l+DT  (B)D(ho)a> 

x(m,  -2)  I “ 

^x(£+l,  -3)/ 

x(l+l)(^  - rT^(l)T^(l)T^(6)D(ho)a> 


and  at  1 we  have 

x(l)  “ rT^(l)T^(B)D(ho)^ 

or 

r"^  x(l)  (J>  « Ty(l)T^(B)D(ho)a> 

or  using  Eq.  (269)  In  Eq.  (266) 

x(i+i)  (^  = n^d)  x(l)  (^ 


(266) 


(267) 


(268) 


(269) 


(270) 


$ . = FBr"  (271) 

xxb 

The  relationships  between  the  states  and  the  variables  over  the  span  can  be 
packaged  for  all  the  forward  difference  case  via  Eq.  (213) 


x(l,  0) 
Ax(l,  0) 


x(l+l,  0)  ... 

Ax(l+1,  0)  ... 


A^x(l,  0)  A^x(l+1,  0)  . 


A**x(l,  0),  A*^x(l+1,  0) 


x(l+N,  0) 
Ax(l+N,  0) 
A^x(l+N,  0) 


A x(l+N,  0) 


x(l,  0) 

x(l+l,  0) 

x(l+N,  0) 

x(l,  1) 

x(l+l,  1) 

x(l+N,  1) 

x(l,  2) 

x(l+l,  2) 

• 

x(l+N,  2) 

• 

x(l,  N) 

• 

• 

x(l+l,  N) 

• 

• 

x(l+N,  N) 

(272) 


A similar  relation  holds  for  Eq.  (261)  connected  via  R . 
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g.  Discrete  Differencing  of  Newton  Polynomials 
The  row  vector  of  x(i,  n)  given  by  Eq.  (235)  is 

x(l,  0),  x(i,  1)  x(i,  2)  ...  x(i,  n)  ...  x(i,  N)  « ^+1)  x(i) 
or  for  d=N  (the  polynomial  degree) 


<^N+1)  x(i)  = <^N+1)  [n>Q  , , n>2 


1 

1 

1 


1 


n+1 

(n+l)^ 

(n+1)^ 


2n  ^n  ^n  („+!)" 


(273) 


(274) 


operating  an  Eq.  (274)  with  U 

,(1) 


<x(i)U  = <A^^^x(i)  = <z^  cl  U 


(n+l)‘ 


where  is  given  by  Eq.  (5])  appendix  (B) , and  is 
L 

T T 

N = C; 


The  matrix  product 

of 

Eq. 

(275)  is 

N^U  = 

1 1 

1 

1 

1 

1 

1 

1 

0 1 

2 

3 

n 

(n+1) 

N 

• • 

2^ 

3^ 

2 

n 

(n+1)^ 

• 

• • 

• • 

0 1 

'N 

n 

• 

(n+1)^ 

U - 

»1  - 

^0 

> 

•••  ^n+1 

- ^n 

...] 

(275) 


(276) 
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1-1 

1-1 

1-1 

1-1 

1 

2-1 

3-2 

. n+l-n 

• 

2^-1 

3^-2^ 

2 2 

. (n+1)  -n*^ 

• 

2^-1 

1 

c 

CM 

2^^-! 

3*^-2*^ 

. . . (n+1)  -n 

(277) 


The  transformation  to  the  backward  factorial  functions  of  Eq.  (44)  appendix  (B)  Is 


"n(0> 

” c ' 

n 

n(^> 

1 

n 

n<2) 

= 

2 

n 

n("> 

n 

n 

yN) 

N 

J 

or 


or 


nN 

/n 


Using  Eq.  (280)  In  Eq.  (235)  transposed 

x(l,  n)  = <a^n>^  = n^  = <gn^  ^ 

where 


Using  Eq.  (281)  In  the  row-vector  of  Eq.  (274) 

<x(l)  ' <g  [n^  ^0  ’ ^1  ’ ^2  ^n  •• 


or  In  open  form 


(278) 


(279) 


(280) 


(281) 


(282) 


(283) 
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By  Eq.  (29)  appendix  (B) , we  have 
<x(i)  = <g  ^ 

where  ^ is  the  matrix  of  backward  factorial  functions. 


The  first  difference  of  Eq.  (283)  is 

( ) 


<x(i)U  = <g  s' 
The  matrix  product  is 


U 


(N+1)  (N+1)  (N+l)xN 


0°  - 


2(0)  _ ^(0) 


0-1 

0 


(1) 


2(1)  _ l(l) 


2^^^  - 0 


We  can  write  Eq.  (286)  as 

<:^x(i)  = 

= <^  A 


<x(i)U 


(1)  s(  ) 


where  the  columns  are 


A<»  S<  > . [A<»  „(  , a'I*  „(  )>^ 

The  n*"^  element  of  the  n^^  column  of  Eq.  (217)  or  Eq.  (290)  is 
A^^>  n^">  = (n+l)^">  - n^">  = nn^^'^^ 


(n+1) 


(0) 


(n+1) 


(1) 


(n+1) 


(n) 


(iH-1) 


(n) 


\ in 


or  the  i-j^^  element  is 


which  Is  the  discreet  analog  of 


The  first  difference  of  the  i column  vector  as  shown  ii  Eq.  (287)  can  be 
written  as 

i^^^  0 0 0 0 0 0 ^C^) 

i^^^  1 1 0 0 0 0 i^^^ 


i(3>  = 


0 2 0 0 

0 0 3 0 


i(N>  ni(”-M  0 


a(^>  i(>>  = vTi< 


N 0 i' 


(N+l)x(N+l) 


which  is  the  discreet  analog  of  Eq.  (2D  section  (4) 


we  thus  have 


^(2)  j^(  )\  „ (vTj2  ^(  )\ 

(3)  i(  )>  =.  (vT)3  i(  < 


A(j)  i(  . (v^)J  iV 

using  Eq.  (297)  in  the  Newton  polynomial  expression  of  Eq.  (281)  and  packaging 
the  discreet  states  as  a column  vector 


,Txj  ,(  ) 


s'  'x(i,  n) 


n) 


n) 


<_g  1 — 1'  -> 

4 ’> 

4 i<«i<  >> 


1<«X(I.  n) 


<6  1<«1<  )> 


■<% 

4'' 

lx(l, 


<g(v'')^ 


1<  >> 


Acv^)". 


Ax(i,  = 


[4^ 

) 

4^ 

>v 

4] 

>v2 

4^ 

4^ 

The  forward  difference  state  vector  is  given  by  Eq.  (223)  as 
Ax^g  = b“'^  x(i)  (N+^ 


By  Eq.  (36)  appendix  (B)  we  have 
- F [S<  >]  . 

or  Eq.  (302)  in  Eq.  (301)  yields 

Ax(i,  n)>g  - F [s^  x(l)  (N+^ 


Transposing  Eq.  (285) 
- J )T 


x(i)^  = s'  ^ 

and  Eq.  (304)  in  Eq.  (303)  yields 


t 


Ax(i,  n)S  - F ^ 


(305) 


Using  the  transpose  o£  Eq.  (282)  in  Eq.  (305) 


Ax(i,  n)X 


(306) 


where 


* T^(i)T^(6)D(ho)^ 


(307) 


Using  Eq.  (307)  in  Eq.  (306) 


Ax(i,  n)^g  = FS*'^  T^(i)T^(8)D(ho)a> 


(308) 


Update  to  i+1 


Ax(i+1,  n)>g  = FS~'^Ty(l)Ty(i)Ty(6)D(ho)a^ 


(309) 


By  Eq.  (308) 

..T  , 


sj  F‘^  Ax(i,  n)>g  = T^(i)T^(B)D(ho)^ 


and  using  Eq.  (310)  in  Eq.  (309) 


Ax(i+1,  n)>  = FS"^  B(l)sJ  Ax(i,  n^ 


or  the  state  transition  matrix 

1)  - FS-^  B<1)SJ  F-l 


(310) 


(311) 


(312) 


Many  other  relations  can  be  obtained  but  will  not  be  pursued  further  here.  One 
can  consider  the  analog  between  the  continuous  monomial  base  and  the  discrete 
"Newton  base"  for  computational  efficiency. 


Section  7 

DIVIDED  DIFFERENCES  AND  INTERPOLATING  POLYNOMIALS 


This  section  derives  some  classical  interpolating  polynomials  in  state 
space  format  with  some  interesting  matrix  relations. 


a.  LaGrange  Interpolating  Polynomials 


Consider  a polynomial  in  time 


f(t)  = ^t  a^ 


and  the  n+1  equi  distance  points  on  the  time  axis  (t^jtj^.t^* • • -t^) . 
Define  the  polynomial 


VCt)  = n(t-t.) 
. 1 
1=0 


'l'(t)  = (t-t  )(t-t,  )(t-t-).  . .(t-t  ) 
0 12  n 


Consider  next  the  n+1  polynomials  generated  by  the  index  i,  that  is 


f (t)  = t-t  = (-t  ,1)  1 

o o o ' 


f-Ct)  = (t-t  )(t-t,)  = t - t^t  - t t + t,t 
1 o 1 1 o 1 o 


= (t-t^)(t-tj^)(t-t2) 


= [-t  t^t-,  t t,  + t t„  + t,t.,  -(t  +t,+t„)l  'l 
2 Ol2  Ol  02  12  012 


'J'-(t)  = (t-t^)(t-t-)(t-t„)(t-t  ) 
3 0 12  3 


-(t  t,t-+t  t,t-+t,t„t,) 
012  Olo  120 

•<V'l*‘2«3> 


where 


(l,t,t^,t  ,t**)  =^5)t 


Define  the  row- tuple  of  polynomials 


<5)©(t)  = *^3 ’^4^  = <l*’*'o»'^l’'^2‘’^3^ 


By  Eq  (4)  through  Eq  (10)  we  have 


t B 0- 


where  the  constant  matrix  B is  the  matrix  of  coordinates  of  the  ^ base 
in  the  monomial  base^,  and  for  the  5x5  example  case  here  looks  like 

0(t)>  = B'^tJ)  (i 


(t-t  )(t-t^) 

O 1 

(t-t  )(t-t^ )(t-t^) 

O i Z 

(t-t  )(t-t, )(t-t-)(t-t_) 
0 12  0 


^0^1  "'•^o^l^2 


0(t)(^ 


^o^l'^2'^3 

-(t  t,t„+t  t,t-+t  t-t,+t.t-t 
01^  Olo  OzO  IZ 

■*^o^l'''^o'^2'^*o^3'^'‘^l'^2‘^^1^3'^'^2^ 
-(t  +t,+t„+t„) 


A-f 


One  could  take  in  Eq  (15)  to  be  the  integers  and  obtain  some 


interesting  matrix  relations. 

Observe  that  the  vectors  are  a base  when  B is  the  invertible,  that 
is  by  proper  selection  of  the  points  t^.  Note  also  that  the  vectors 
become  zero  as  a function  of  t when  t = t^;  thus  they  act  like  a base  only 


between  the  t^  points. 


Define  a new  set  of  polynomials 
n 


g^(t)  = n (t-t.) 
1=0 


(16) 


i?<k 

k = 0,1,2,. 


For  example  for  n=3,  these  four  polynomials  are 


go  = (t-t^)(t-t2)(t-t3) 


= (t-to)(t-t2)U-t3) 


(17) 


§2  = (t-t^Xt-t^Xt-tg) 


g3(t)  = (t-to)(t-t3^)(t-t2) 


Clearly  these  polynomials  can  be  written  as 


go(t) 


gj^(t) 


g2(t) 


g3(t) 


:(t-t  )-^ 


(t-t^) 


-1 


(t-t2) 


-1 


(t-ta) 


4'3(t) 


(18) 


These  polynomials  evaluated  at  the  t.  points  are  different  from  zero, 
that  is  for  distinct  t ^ , we  have 


<^k-^o> 


^''^k"'‘^k-l^^''^k“\+l^ 


.(tj^-t^)  * 0 (19) 


and  for  the  four  polynomials 


g„(t  ) = (t  -t  )(t  -t  )(t  -t„) 
O O O J.  O 2 O 3 


gl(ti)  = (t^-to)(Vt2)(t^-t3) 


(20) 


®2^^2^  = (t2-to)(t2-tj^)(t2-t3) 


i i 


t I! 

I 


I 


*.  (t)  = (t-t,  )(t-t-)(t-t„) 

O X 2 o 

(t  -t,)(t  -t„)(t  -t.) 
0 1 o 2 0 3 


A (t)  = (t-t  )(t-t  )(t-t,) 
1 0 2 3 


TtpryitpyTt^ 


A (t)  = (t-t  )(t-t,)(t-t-) 
2 0 13 


Ag(t)  = (t-t^)(t-tj^)(t-t2) 


Note  that 


O O 


^2^ '*^2^ 


^3^^3^ 


or 


1° 


i ^ k 


Eq  ( 26 ) can  be  written  as 

Jl(t)(4>  = D"^(g^)  g(t)(ij) 

Using  Eq  (22)  in  Eq  (28) 

A(t)(4)>  = D“^(gj^)  G t(4) 

also 

[A(t^))  , A(t^)),  A(t2)),  A(t3))]  = I 


4x4 


(27) 


(28) 


(29) 


(30) 


(31) 


One  can  now  obtain  the  derivatives  and  higher  derivativei  of  the 
polynomials  of  Eq  (30)  as 


A(t)  ) = D"^(g^)  G t) 


(32) 


A(d-l) 


(t)^  = D"^(gj^)  G t) 
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1 


,1 

J: 

j; 

j 


J; 


I 


J 


;i: 


1 


etc. 

The  relation  of  Eq  (30)  provides  a nice  matrix- theoretic  "goodie" 
for  by  Eq  ( 31 ) 

[)l(t^))  » Jl(t^) > , G T = I (33) 

where  T is  the  Vandermonde  matrix  

1 I 


T = 


(34) 


or  the  inverse  of  the  Vandermonde  matrix  is  very  loosely  constructed  to  be 
by  Eq  (33) 


Likewise 


and 


T“^  = D~^(g^)  G 


T = G~hig^) 


TD"^(g^)  = G"^ 


(35) 


(36) 


(37) 


Hence  the  matrix  of  Eq  (23)  is  easily  obtained;  the  open  form  for  the  G 
matrix  is  given  in  Eq  (21). 


Consider  now  an  approximating  function 
p(t)  =^+l)a  Jl(t)(n+l\ 


(38) 


where  the  fitting  functions  A(t)^  are  those  of  Eq  (30),  then  an  arbitrary 
function  x(t)  can  be  approximated  by 


or 


x(t)  = p(t)  + X (t) 


x(t)  = ^a  i(t)^  + x^(t) 


(39) 


(40) 


where  x (t)  is  the  approximating  error.  The  function  evaluated  at  the  t. 


points  is 


[x(t^),  x(t^) . . .x(t^)  =-^a  / (‘♦D 
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. .r~— 


J 


or  by  equation  (31)  in  Eq  (41) 
^^l)x  = ^ a I + 


(42) 


If  the  function  values  are  known  at  the  points  t.,  apply  the  n+1 
constraints 


(43) 


(44) 


^+l)x  = ^ a 

or  using  Eq  (43)  in  Eq  (40) 

x(t)  = ^n+l)x  J,  (t)(n+l^  + x^(‘t) 
and  by  Eq  (38) 

p(t)  = 'Cn+Dx  H (t)(n+l^  (45) 

which  is  called  the  LaGrange  form  of  the  interpolation  polynomial. 

One  can  prove  a standard  theorem  which  states:  Theorem : Given  a 
real  valued  function  x(t)  and  n+1  distinct  points  t^,tj^...t^,  there  exists 


exactly  one  polynomial  of  degree  <n  which  interpolates  x(t)  at  t^,t^,...t^. 


By  Eq  (18) 

’i'(t)  = C(t-t^)  ,(t-t^) , . . . (t-t^)]  g(t) 


m 


= E (t-t.)g.(t) 
i=l  ^ ^ 


(46) 

(47) 


By  Eq  (2) 


^(t)  = (t-t  )(t-t  )...(t-t  ) 
o 1 n 


(48) 


and  the  derivative  is 


y(t)  = (t-t, ) . . .(t-t  ) + (t-t  )(t-t-). . .+(t-t  )(t-t, ) . . .(t-t  ) 

1 n o2  ol  n-l 


or 


^(t)  = gQ(t)  + g^(t)  +...g^(t) 

y(t)  = ■^'i  g(t)^ 


(49) 


(50) 


If  we  evaluated  the  derivative  at  the  t^,  points  by  Eq  (24)  we  obtain 


1 


Ji 
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i (t) 
o 


4'(t  )(t-t  ) 
o o 


!_  y(t  )(t-t  ) 

n n 

Using  Eq  (55)  in  Eq  (45),  the  interpolating  polynomial  is  seen  to  be 

p(t)  = [x(t  ),  x(t,  ) . . . x(t  )]  'y(t) 

o i n T 

^(t  )(t-t  ) 
o o 


p(t)  = E x(t.)  'J'(t) 

1 A 


By  Eq  (29) 


'l'(t.)(t-t.) 
1 1 


J!.(t)^  = D ^(g]^)  g(t)^ 

<(l  A(t))=^  ^ 


4'(t  )(t-t  ) 
n n 


^1  «.(t)^  = (g“^(t^),  g"^(t^)...g"^(t^)  jgQ(t)l 


i®n(^>l 

b.  Newton  Form  of  Interpolating  Polynomials  and  Generalized  weighted 
Differences. 

Consider  some  weighted  differences  of  x(i),  i=i,2,3,4 


r 


I 


or 


Cx(o),  x(l),  x(2),  x(3)] 


-1 

1 

0 

0 


0 0 

-1  0 

1 -1 

0 1 


where 


(61) 

= [Ax(o),  Ax(l),  Ax{2)] 


[Ax(o),  Ax(l),  Ax(2)]  = [x(l)-x(o),  x(2)-x(l),  x(3)-x(2)J  (62) 

if  we  now  define  the  generalized  weights  of  Eq  (155)  sec  ( 6 ) as 


(t^-ti)-^  = h;^  = w^^ 

(to-t2)"^  = h;^  = w^2 

^ V^3^'^  = ^3  = ”o3 

(ti-t2)  = h^2  = ^^12 

(t^-t3)-^  = h-^  = w^3 

(t2-t3)-^  = h^l  = W23 


By  Eq  (63)  the  weighted  difference  matrix  is 
[x(o),x(l) ,x(2),x(3)]{ 


(63) 


-'^ol 

0 

0 

^01 

-'^12 

0 

0 

"12 

“”23 

0 

0 

CO 

CM 

(64) 


C 


x(l)-x(o)  , x(2)-x(l)  , 


1 o 


^2-^1 


x(3)-x(2) 

"3-^2 


•] 


Define  the  first  divided  differences  of  Eq  (64)  via  the  double  index 


399 


x(l)-x(o) 

■h  ' 

x(o,l)  ■ 

Lj  —X 

1 0 

1 

I 

j 

x(2)-x(l)  : = 

+•  _+• 

x(l,2) I = 

A^lX(l) 

2 1 j 

I 

x(3)-x(2) 

t*  —1"  ^ 

CO 

CM 

Ah2x(2) 

^3  ^2  J 

_ I 

. . _ 

Define  the  second  divided  differences  as 


I 


[x(o,l) ,x(l,2) ,x(2,3)]  :-h 


- rx(i»2)-x(o,l) 

~ ^ t -t 
2 o 


-1 

o2 

-1 

^o2 


' 0 


13  I 


J 

x(2.3)-x(l,2)  j 


"3-"l 


= Cx(o,l,2)  , x(l,2,3)] 


The  successive  products,  Eq  (64)  and  Eq  (66)  is 

f I* 


-1 


(x^.xj^.x^.xg)  i-h;^ 
-1 


1 

I 


-h 


-1 


12 

-1 


‘12 


-h 


-1 


23 

-1 


23 


(x^.x^.x^.Xg) 


h 1 h „ 
ol  o2 


“^ol  ^o2  "^12  ^o2 


^12  ^02 


u-1 

i'^2 


-1 


o2 


-h 


13 


-1 


13 


^12  ^13 


u-1  v-1  u-1! 

■^12  ^13  "^23  ^13! 


^23  ^13 


0 


4x3  3x2 


g'^(ti) 


•2  o''  2 1''  2 3' 


i ®2  ^^2^ 


: ®3  ^^3^ 


In  a similar  manner  one  can  show  with  i=4  or  five  data  points 


^)x  H H H H = x(t^,t^,t2,t3,tj^) 


5x4  4x3  3x2  2x1 


aJ^^x(o) 

^04 


where 


-t  )(t  -t»)(t  -t  )(t  -t  ) 
ol  o2  oo  o4 


I g„(t  ) ' 

! O O 1 


. ti-t©  ) ( t 2 ) ( t j^-t  2 ) ( J 


1 ! 

i^l 


i 


1 ^^4”^o  ^^4"^1^^^4~^2  ^^4~^3 


! 


The  general  expressions 


x(to,ti,t2,...tn)  = I 


Z x(ti) 

i=o  Si^ 


or  Eq  (79)  can  be  written  as 

or 

^5)A^  ^x(t^)L"’’  =^)  X 

the  row  vector  of  function  values.  By  Eq  (45) 

p(t)  ='^)  X Jl(t)  (^ 

and  Eq  (81)  in  Eq  (82) 

p(t)  = (b)L^  ^x(t^)  L‘'^£(t)(5) 

For  ■'the  4x4  case  it  is  easy  to  show  for  example  that 


O 

1 

CM 

0 

0 

- 0 

(t„-t_)(t^-t, )(t,-t„) 

The  matrix  of  Eq  (84)  is  the  row- tuple  of  the  base  polynomials  of 
Eq  (14)  (that  is  the  first  4) 


^ (t)(4)  = 

1 

( 

t-t  i 

o 1 

(85) 

i 

1 

(t-t  )(t-t  ) ! 

o 1 , 

1 (t-t  )(t-t  )(t-t  ) ! 

O 1 2 ; 

' 1 

[e(t^)(4>  , ^t^)(4>  , ^t2)(4>  , 0(t3)(4>  ] = 

4x4 

The  standard  Newton-form  of  the  polynomial  of  Eq  (83)  is 

(86) 

n i-1 

p(t)  = E x(t^,t^,.,.t.)  n (t-tj)  (87) 

i=o  j=o 

It  is^believed  that  the  foregoing  state-space  methods  applied  to 
classical  interpolation,  and  extended  to  cubic-splines,  B-splines,  etc. 
will  yield  beautiful  simplifications. 
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